2023-07-18 04:10:15,945 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-18 04:10:16,198 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6 2023-07-18 04:10:16,198 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-18 04:10:16,199 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-18 04:10:16,238 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-18 04:10:16,497 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-18 04:10:16,497 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/cluster_5a53e081-17bb-4aef-d48c-01add87bea50, deleteOnExit=true 2023-07-18 04:10:16,498 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-18 04:10:16,498 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/test.cache.data in system properties and HBase conf 2023-07-18 04:10:16,498 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/hadoop.tmp.dir in system properties and HBase conf 2023-07-18 04:10:16,499 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/hadoop.log.dir in system properties and HBase conf 2023-07-18 04:10:16,500 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-18 04:10:16,500 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-18 04:10:16,500 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-18 04:10:16,828 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-18 04:10:16,834 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-18 04:10:16,834 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-18 04:10:16,835 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-18 04:10:16,835 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-18 04:10:16,836 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-18 04:10:16,836 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-18 04:10:16,837 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-18 04:10:16,837 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-18 04:10:16,838 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-18 04:10:16,838 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/nfs.dump.dir in system properties and HBase conf 2023-07-18 04:10:16,838 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/java.io.tmpdir in system properties and HBase conf 2023-07-18 04:10:16,839 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-18 04:10:16,839 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-18 04:10:16,840 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-18 04:10:17,465 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-18 04:10:17,470 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-18 04:10:17,751 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-18 04:10:17,921 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-18 04:10:17,938 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 04:10:17,973 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 04:10:18,024 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/java.io.tmpdir/Jetty_localhost_45701_hdfs____uefpj5/webapp 2023-07-18 04:10:18,199 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45701 2023-07-18 04:10:18,257 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-18 04:10:18,257 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-18 04:10:18,797 WARN [Listener at localhost/43229] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-18 04:10:18,886 WARN [Listener at localhost/43229] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-18 04:10:18,909 WARN [Listener at localhost/43229] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 04:10:18,917 INFO [Listener at localhost/43229] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 04:10:18,924 INFO [Listener at localhost/43229] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/java.io.tmpdir/Jetty_localhost_38919_datanode____ojdjsz/webapp 2023-07-18 04:10:19,085 INFO [Listener at localhost/43229] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38919 2023-07-18 04:10:19,593 WARN [Listener at localhost/38857] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-18 04:10:19,636 WARN [Listener at localhost/38857] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-18 04:10:19,642 WARN [Listener at localhost/38857] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 04:10:19,645 INFO [Listener at localhost/38857] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 04:10:19,653 INFO [Listener at localhost/38857] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/java.io.tmpdir/Jetty_localhost_43111_datanode____.gz207/webapp 2023-07-18 04:10:19,783 INFO [Listener at localhost/38857] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43111 2023-07-18 04:10:19,802 WARN [Listener at localhost/45925] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-18 04:10:19,885 WARN [Listener at localhost/45925] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-18 04:10:19,896 WARN [Listener at localhost/45925] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 04:10:19,898 INFO [Listener at localhost/45925] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 04:10:19,916 INFO [Listener at localhost/45925] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/java.io.tmpdir/Jetty_localhost_40537_datanode____7px3gk/webapp 2023-07-18 04:10:20,052 INFO [Listener at localhost/45925] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40537 2023-07-18 04:10:20,096 WARN [Listener at localhost/38339] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-18 04:10:20,368 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xeb455f602c0e196c: Processing first storage report for DS-7eea9563-e4ce-4ba7-941d-1b47c3119829 from datanode 9f179317-61d8-4a53-8bac-dcd0d5dd81c1 2023-07-18 04:10:20,370 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xeb455f602c0e196c: from storage DS-7eea9563-e4ce-4ba7-941d-1b47c3119829 node DatanodeRegistration(127.0.0.1:46683, datanodeUuid=9f179317-61d8-4a53-8bac-dcd0d5dd81c1, infoPort=34209, infoSecurePort=0, ipcPort=38857, storageInfo=lv=-57;cid=testClusterID;nsid=539422941;c=1689653417541), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-18 04:10:20,371 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9a6eaff25d85964f: Processing first storage report for DS-7f052418-6e23-403c-a0b3-1b3a2d5b1c00 from datanode 9baa9f1f-ac39-4f29-bf5a-4e60405968e1 2023-07-18 04:10:20,371 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9a6eaff25d85964f: from storage DS-7f052418-6e23-403c-a0b3-1b3a2d5b1c00 node DatanodeRegistration(127.0.0.1:36843, datanodeUuid=9baa9f1f-ac39-4f29-bf5a-4e60405968e1, infoPort=36523, infoSecurePort=0, ipcPort=45925, storageInfo=lv=-57;cid=testClusterID;nsid=539422941;c=1689653417541), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 04:10:20,371 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xeb455f602c0e196c: Processing first storage report for DS-1bf25a7f-5c52-49fd-93cd-2f7a1d58ec5b from datanode 9f179317-61d8-4a53-8bac-dcd0d5dd81c1 2023-07-18 04:10:20,371 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xeb455f602c0e196c: from storage DS-1bf25a7f-5c52-49fd-93cd-2f7a1d58ec5b node DatanodeRegistration(127.0.0.1:46683, datanodeUuid=9f179317-61d8-4a53-8bac-dcd0d5dd81c1, infoPort=34209, infoSecurePort=0, ipcPort=38857, storageInfo=lv=-57;cid=testClusterID;nsid=539422941;c=1689653417541), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 04:10:20,372 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9a6eaff25d85964f: Processing first storage report for DS-70b8b64b-7882-4732-9f7d-0a39197503fb from datanode 9baa9f1f-ac39-4f29-bf5a-4e60405968e1 2023-07-18 04:10:20,372 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9a6eaff25d85964f: from storage DS-70b8b64b-7882-4732-9f7d-0a39197503fb node DatanodeRegistration(127.0.0.1:36843, datanodeUuid=9baa9f1f-ac39-4f29-bf5a-4e60405968e1, infoPort=36523, infoSecurePort=0, ipcPort=45925, storageInfo=lv=-57;cid=testClusterID;nsid=539422941;c=1689653417541), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 04:10:20,397 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xca21cf8d78af0398: Processing first storage report for DS-fcfa53cf-cafc-4864-8e88-e4d248c589f9 from datanode df5eb385-908c-4373-a76a-1bd106aa162f 2023-07-18 04:10:20,398 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xca21cf8d78af0398: from storage DS-fcfa53cf-cafc-4864-8e88-e4d248c589f9 node DatanodeRegistration(127.0.0.1:38543, datanodeUuid=df5eb385-908c-4373-a76a-1bd106aa162f, infoPort=34487, infoSecurePort=0, ipcPort=38339, storageInfo=lv=-57;cid=testClusterID;nsid=539422941;c=1689653417541), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-18 04:10:20,398 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xca21cf8d78af0398: Processing first storage report for DS-e10fd30a-43e9-4f16-940b-07ba5fb34a8a from datanode df5eb385-908c-4373-a76a-1bd106aa162f 2023-07-18 04:10:20,398 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xca21cf8d78af0398: from storage DS-e10fd30a-43e9-4f16-940b-07ba5fb34a8a node DatanodeRegistration(127.0.0.1:38543, datanodeUuid=df5eb385-908c-4373-a76a-1bd106aa162f, infoPort=34487, infoSecurePort=0, ipcPort=38339, storageInfo=lv=-57;cid=testClusterID;nsid=539422941;c=1689653417541), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 04:10:20,620 DEBUG [Listener at localhost/38339] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6 2023-07-18 04:10:20,710 INFO [Listener at localhost/38339] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/cluster_5a53e081-17bb-4aef-d48c-01add87bea50/zookeeper_0, clientPort=64260, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/cluster_5a53e081-17bb-4aef-d48c-01add87bea50/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/cluster_5a53e081-17bb-4aef-d48c-01add87bea50/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-18 04:10:20,742 INFO [Listener at localhost/38339] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64260 2023-07-18 04:10:20,753 INFO [Listener at localhost/38339] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 04:10:20,756 INFO [Listener at localhost/38339] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 04:10:21,445 INFO [Listener at localhost/38339] util.FSUtils(471): Created version file at hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8 with version=8 2023-07-18 04:10:21,445 INFO [Listener at localhost/38339] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/hbase-staging 2023-07-18 04:10:21,785 INFO [Listener at localhost/38339] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-18 04:10:22,414 INFO [Listener at localhost/38339] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-18 04:10:22,464 INFO [Listener at localhost/38339] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 04:10:22,465 INFO [Listener at localhost/38339] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-18 04:10:22,465 INFO [Listener at localhost/38339] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-18 04:10:22,465 INFO [Listener at localhost/38339] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 04:10:22,465 INFO [Listener at localhost/38339] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-18 04:10:22,667 INFO [Listener at localhost/38339] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-18 04:10:22,758 DEBUG [Listener at localhost/38339] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-18 04:10:22,869 INFO [Listener at localhost/38339] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46231 2023-07-18 04:10:22,889 INFO [Listener at localhost/38339] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 04:10:22,891 INFO [Listener at localhost/38339] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 04:10:22,921 INFO [Listener at localhost/38339] zookeeper.RecoverableZooKeeper(93): Process identifier=master:46231 connecting to ZooKeeper ensemble=127.0.0.1:64260 2023-07-18 04:10:22,976 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:462310x0, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 04:10:22,979 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:46231-0x101769fa5910000 connected 2023-07-18 04:10:23,021 DEBUG [Listener at localhost/38339] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 04:10:23,022 DEBUG [Listener at localhost/38339] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 04:10:23,036 DEBUG [Listener at localhost/38339] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-18 04:10:23,044 DEBUG [Listener at localhost/38339] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46231 2023-07-18 04:10:23,046 DEBUG [Listener at localhost/38339] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46231 2023-07-18 04:10:23,050 DEBUG [Listener at localhost/38339] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46231 2023-07-18 04:10:23,055 DEBUG [Listener at localhost/38339] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46231 2023-07-18 04:10:23,058 DEBUG [Listener at localhost/38339] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46231 2023-07-18 04:10:23,067 INFO [Listener at localhost/38339] master.HMaster(444): hbase.rootdir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8, hbase.cluster.distributed=false 2023-07-18 04:10:23,142 INFO [Listener at localhost/38339] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-18 04:10:23,142 INFO [Listener at localhost/38339] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 04:10:23,143 INFO [Listener at localhost/38339] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-18 04:10:23,143 INFO [Listener at localhost/38339] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-18 04:10:23,143 INFO [Listener at localhost/38339] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 04:10:23,143 INFO [Listener at localhost/38339] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-18 04:10:23,148 INFO [Listener at localhost/38339] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-18 04:10:23,151 INFO [Listener at localhost/38339] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35525 2023-07-18 04:10:23,154 INFO [Listener at localhost/38339] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-18 04:10:23,161 INFO [Listener at localhost/38339] mob.MobFileCache(124): MobFileCache disabled 2023-07-18 04:10:23,162 INFO [Listener at localhost/38339] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 04:10:23,164 INFO [Listener at localhost/38339] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 04:10:23,166 INFO [Listener at localhost/38339] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35525 connecting to ZooKeeper ensemble=127.0.0.1:64260 2023-07-18 04:10:23,179 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:355250x0, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 04:10:23,180 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35525-0x101769fa5910001 connected 2023-07-18 04:10:23,180 DEBUG [Listener at localhost/38339] zookeeper.ZKUtil(164): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 04:10:23,182 DEBUG [Listener at localhost/38339] zookeeper.ZKUtil(164): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 04:10:23,183 DEBUG [Listener at localhost/38339] zookeeper.ZKUtil(164): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-18 04:10:23,186 DEBUG [Listener at localhost/38339] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35525 2023-07-18 04:10:23,188 DEBUG [Listener at localhost/38339] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35525 2023-07-18 04:10:23,191 DEBUG [Listener at localhost/38339] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35525 2023-07-18 04:10:23,193 DEBUG [Listener at localhost/38339] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35525 2023-07-18 04:10:23,193 DEBUG [Listener at localhost/38339] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35525 2023-07-18 04:10:23,206 INFO [Listener at localhost/38339] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-18 04:10:23,206 INFO [Listener at localhost/38339] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 04:10:23,207 INFO [Listener at localhost/38339] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-18 04:10:23,207 INFO [Listener at localhost/38339] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-18 04:10:23,208 INFO [Listener at localhost/38339] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 04:10:23,208 INFO [Listener at localhost/38339] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-18 04:10:23,208 INFO [Listener at localhost/38339] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-18 04:10:23,209 INFO [Listener at localhost/38339] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42889 2023-07-18 04:10:23,210 INFO [Listener at localhost/38339] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-18 04:10:23,215 INFO [Listener at localhost/38339] mob.MobFileCache(124): MobFileCache disabled 2023-07-18 04:10:23,216 INFO [Listener at localhost/38339] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 04:10:23,227 INFO [Listener at localhost/38339] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 04:10:23,229 INFO [Listener at localhost/38339] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42889 connecting to ZooKeeper ensemble=127.0.0.1:64260 2023-07-18 04:10:23,235 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:428890x0, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 04:10:23,236 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42889-0x101769fa5910002 connected 2023-07-18 04:10:23,236 DEBUG [Listener at localhost/38339] zookeeper.ZKUtil(164): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 04:10:23,237 DEBUG [Listener at localhost/38339] zookeeper.ZKUtil(164): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 04:10:23,238 DEBUG [Listener at localhost/38339] zookeeper.ZKUtil(164): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-18 04:10:23,243 DEBUG [Listener at localhost/38339] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42889 2023-07-18 04:10:23,246 DEBUG [Listener at localhost/38339] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42889 2023-07-18 04:10:23,247 DEBUG [Listener at localhost/38339] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42889 2023-07-18 04:10:23,248 DEBUG [Listener at localhost/38339] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42889 2023-07-18 04:10:23,248 DEBUG [Listener at localhost/38339] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42889 2023-07-18 04:10:23,268 INFO [Listener at localhost/38339] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-18 04:10:23,269 INFO [Listener at localhost/38339] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 04:10:23,269 INFO [Listener at localhost/38339] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-18 04:10:23,269 INFO [Listener at localhost/38339] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-18 04:10:23,269 INFO [Listener at localhost/38339] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 04:10:23,269 INFO [Listener at localhost/38339] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-18 04:10:23,270 INFO [Listener at localhost/38339] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-18 04:10:23,272 INFO [Listener at localhost/38339] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43385 2023-07-18 04:10:23,272 INFO [Listener at localhost/38339] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-18 04:10:23,283 INFO [Listener at localhost/38339] mob.MobFileCache(124): MobFileCache disabled 2023-07-18 04:10:23,284 INFO [Listener at localhost/38339] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 04:10:23,286 INFO [Listener at localhost/38339] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 04:10:23,288 INFO [Listener at localhost/38339] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43385 connecting to ZooKeeper ensemble=127.0.0.1:64260 2023-07-18 04:10:23,294 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:433850x0, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 04:10:23,296 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43385-0x101769fa5910003 connected 2023-07-18 04:10:23,296 DEBUG [Listener at localhost/38339] zookeeper.ZKUtil(164): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 04:10:23,297 DEBUG [Listener at localhost/38339] zookeeper.ZKUtil(164): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 04:10:23,298 DEBUG [Listener at localhost/38339] zookeeper.ZKUtil(164): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-18 04:10:23,303 DEBUG [Listener at localhost/38339] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43385 2023-07-18 04:10:23,307 DEBUG [Listener at localhost/38339] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43385 2023-07-18 04:10:23,311 DEBUG [Listener at localhost/38339] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43385 2023-07-18 04:10:23,312 DEBUG [Listener at localhost/38339] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43385 2023-07-18 04:10:23,314 DEBUG [Listener at localhost/38339] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43385 2023-07-18 04:10:23,319 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,46231,1689653421609 2023-07-18 04:10:23,332 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-18 04:10:23,335 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,46231,1689653421609 2023-07-18 04:10:23,365 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-18 04:10:23,365 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-18 04:10:23,365 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-18 04:10:23,365 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-18 04:10:23,366 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 04:10:23,367 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-18 04:10:23,369 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,46231,1689653421609 from backup master directory 2023-07-18 04:10:23,370 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-18 04:10:23,374 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,46231,1689653421609 2023-07-18 04:10:23,374 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-18 04:10:23,375 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-18 04:10:23,375 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,46231,1689653421609 2023-07-18 04:10:23,379 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-18 04:10:23,381 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-18 04:10:23,505 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/hbase.id with ID: f9bee3fe-5ae2-4ef4-8521-1a60ff01bd55 2023-07-18 04:10:23,557 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 04:10:23,575 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 04:10:23,649 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x7ef6ca3b to 127.0.0.1:64260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:10:23,690 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b47dad2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:10:23,720 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 04:10:23,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-18 04:10:23,751 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-18 04:10:23,751 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-18 04:10:23,754 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-18 04:10:23,760 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-18 04:10:23,761 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 04:10:23,811 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/MasterData/data/master/store-tmp 2023-07-18 04:10:23,861 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:10:23,861 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-18 04:10:23,861 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 04:10:23,861 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 04:10:23,861 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-18 04:10:23,862 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 04:10:23,862 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 04:10:23,862 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-18 04:10:23,865 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/MasterData/WALs/jenkins-hbase4.apache.org,46231,1689653421609 2023-07-18 04:10:23,892 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46231%2C1689653421609, suffix=, logDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/MasterData/WALs/jenkins-hbase4.apache.org,46231,1689653421609, archiveDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/MasterData/oldWALs, maxLogs=10 2023-07-18 04:10:23,978 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38543,DS-fcfa53cf-cafc-4864-8e88-e4d248c589f9,DISK] 2023-07-18 04:10:23,978 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36843,DS-7f052418-6e23-403c-a0b3-1b3a2d5b1c00,DISK] 2023-07-18 04:10:23,978 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46683,DS-7eea9563-e4ce-4ba7-941d-1b47c3119829,DISK] 2023-07-18 04:10:23,994 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-18 04:10:24,075 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/MasterData/WALs/jenkins-hbase4.apache.org,46231,1689653421609/jenkins-hbase4.apache.org%2C46231%2C1689653421609.1689653423904 2023-07-18 04:10:24,087 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46683,DS-7eea9563-e4ce-4ba7-941d-1b47c3119829,DISK], DatanodeInfoWithStorage[127.0.0.1:36843,DS-7f052418-6e23-403c-a0b3-1b3a2d5b1c00,DISK], DatanodeInfoWithStorage[127.0.0.1:38543,DS-fcfa53cf-cafc-4864-8e88-e4d248c589f9,DISK]] 2023-07-18 04:10:24,088 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-18 04:10:24,088 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:10:24,092 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-18 04:10:24,093 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-18 04:10:24,189 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-18 04:10:24,199 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-18 04:10:24,238 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-18 04:10:24,255 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:10:24,263 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-18 04:10:24,265 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-18 04:10:24,288 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-18 04:10:24,293 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 04:10:24,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67227808, jitterRate=0.0017724037170410156}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 04:10:24,301 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-18 04:10:24,303 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-18 04:10:24,328 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-18 04:10:24,328 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-18 04:10:24,332 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-18 04:10:24,334 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-18 04:10:24,379 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 44 msec 2023-07-18 04:10:24,379 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-18 04:10:24,416 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-18 04:10:24,422 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-18 04:10:24,450 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-18 04:10:24,456 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-18 04:10:24,457 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-18 04:10:24,463 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-18 04:10:24,467 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-18 04:10:24,474 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 04:10:24,479 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-18 04:10:24,479 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-18 04:10:24,495 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-18 04:10:24,500 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-18 04:10:24,500 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-18 04:10:24,501 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-18 04:10:24,501 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 04:10:24,505 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-18 04:10:24,506 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,46231,1689653421609, sessionid=0x101769fa5910000, setting cluster-up flag (Was=false) 2023-07-18 04:10:24,523 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 04:10:24,536 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-18 04:10:24,538 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46231,1689653421609 2023-07-18 04:10:24,545 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 04:10:24,553 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-18 04:10:24,555 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46231,1689653421609 2023-07-18 04:10:24,557 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp 2023-07-18 04:10:24,620 INFO [RS:2;jenkins-hbase4:43385] regionserver.HRegionServer(951): ClusterId : f9bee3fe-5ae2-4ef4-8521-1a60ff01bd55 2023-07-18 04:10:24,620 INFO [RS:0;jenkins-hbase4:35525] regionserver.HRegionServer(951): ClusterId : f9bee3fe-5ae2-4ef4-8521-1a60ff01bd55 2023-07-18 04:10:24,622 INFO [RS:1;jenkins-hbase4:42889] regionserver.HRegionServer(951): ClusterId : f9bee3fe-5ae2-4ef4-8521-1a60ff01bd55 2023-07-18 04:10:24,629 DEBUG [RS:1;jenkins-hbase4:42889] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-18 04:10:24,630 DEBUG [RS:0;jenkins-hbase4:35525] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-18 04:10:24,630 DEBUG [RS:2;jenkins-hbase4:43385] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-18 04:10:24,639 DEBUG [RS:2;jenkins-hbase4:43385] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-18 04:10:24,639 DEBUG [RS:1;jenkins-hbase4:42889] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-18 04:10:24,640 DEBUG [RS:2;jenkins-hbase4:43385] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-18 04:10:24,640 DEBUG [RS:1;jenkins-hbase4:42889] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-18 04:10:24,648 DEBUG [RS:2;jenkins-hbase4:43385] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-18 04:10:24,648 DEBUG [RS:1;jenkins-hbase4:42889] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-18 04:10:24,652 DEBUG [RS:1;jenkins-hbase4:42889] zookeeper.ReadOnlyZKClient(139): Connect 0x342c7858 to 127.0.0.1:64260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:10:24,654 DEBUG [RS:0;jenkins-hbase4:35525] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-18 04:10:24,654 DEBUG [RS:0;jenkins-hbase4:35525] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-18 04:10:24,654 DEBUG [RS:2;jenkins-hbase4:43385] zookeeper.ReadOnlyZKClient(139): Connect 0x1fb3343b to 127.0.0.1:64260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:10:24,656 DEBUG [RS:0;jenkins-hbase4:35525] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-18 04:10:24,664 DEBUG [RS:0;jenkins-hbase4:35525] zookeeper.ReadOnlyZKClient(139): Connect 0x03396479 to 127.0.0.1:64260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:10:24,683 DEBUG [RS:1;jenkins-hbase4:42889] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e24996, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:10:24,684 DEBUG [RS:1;jenkins-hbase4:42889] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5709c2c3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-18 04:10:24,690 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-18 04:10:24,696 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:10:24,696 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-18 04:10:24,729 DEBUG [RS:0;jenkins-hbase4:35525] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@463bfa7a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:10:24,729 DEBUG [RS:2;jenkins-hbase4:43385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c37fd1c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:10:24,730 DEBUG [RS:0;jenkins-hbase4:35525] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47831cf3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-18 04:10:24,731 DEBUG [RS:2;jenkins-hbase4:43385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@dbf0838, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-18 04:10:24,746 DEBUG [RS:1;jenkins-hbase4:42889] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:42889 2023-07-18 04:10:24,748 DEBUG [RS:0;jenkins-hbase4:35525] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:35525 2023-07-18 04:10:24,746 DEBUG [RS:2;jenkins-hbase4:43385] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:43385 2023-07-18 04:10:24,755 INFO [RS:1;jenkins-hbase4:42889] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-18 04:10:24,755 INFO [RS:0;jenkins-hbase4:35525] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-18 04:10:24,755 INFO [RS:1;jenkins-hbase4:42889] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-18 04:10:24,755 INFO [RS:2;jenkins-hbase4:43385] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-18 04:10:24,756 INFO [RS:2;jenkins-hbase4:43385] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-18 04:10:24,756 DEBUG [RS:1;jenkins-hbase4:42889] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-18 04:10:24,756 DEBUG [RS:2;jenkins-hbase4:43385] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-18 04:10:24,756 INFO [RS:0;jenkins-hbase4:35525] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-18 04:10:24,757 INFO [RS:1;jenkins-hbase4:42889] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:10:24,759 DEBUG [RS:1;jenkins-hbase4:42889] regionserver.HRegionServer(1022): About to register with Master. 2023-07-18 04:10:24,759 INFO [RS:2;jenkins-hbase4:43385] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:10:24,759 DEBUG [RS:2;jenkins-hbase4:43385] regionserver.HRegionServer(1022): About to register with Master. 2023-07-18 04:10:24,759 DEBUG [RS:0;jenkins-hbase4:35525] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-18 04:10:24,760 INFO [RS:0;jenkins-hbase4:35525] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:10:24,760 DEBUG [RS:0;jenkins-hbase4:35525] regionserver.HRegionServer(1022): About to register with Master. 2023-07-18 04:10:24,762 INFO [RS:1;jenkins-hbase4:42889] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46231,1689653421609 with isa=jenkins-hbase4.apache.org/172.31.14.131:42889, startcode=1689653423206 2023-07-18 04:10:24,763 INFO [RS:2;jenkins-hbase4:43385] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46231,1689653421609 with isa=jenkins-hbase4.apache.org/172.31.14.131:43385, startcode=1689653423267 2023-07-18 04:10:24,763 INFO [RS:0;jenkins-hbase4:35525] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46231,1689653421609 with isa=jenkins-hbase4.apache.org/172.31.14.131:35525, startcode=1689653423141 2023-07-18 04:10:24,787 DEBUG [RS:1;jenkins-hbase4:42889] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-18 04:10:24,788 DEBUG [RS:2;jenkins-hbase4:43385] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-18 04:10:24,787 DEBUG [RS:0;jenkins-hbase4:35525] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-18 04:10:24,810 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-18 04:10:24,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-18 04:10:24,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-18 04:10:24,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-18 04:10:24,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-18 04:10:24,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-18 04:10:24,837 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:24,837 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-18 04:10:24,837 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:24,887 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689653454887 2023-07-18 04:10:24,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-18 04:10:24,900 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55719, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-18 04:10:24,900 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51615, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-18 04:10:24,904 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48915, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-18 04:10:24,907 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-18 04:10:24,908 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-18 04:10:24,911 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46231] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 04:10:24,915 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-18 04:10:24,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-18 04:10:24,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-18 04:10:24,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-18 04:10:24,926 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-18 04:10:24,926 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-18 04:10:24,929 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:24,932 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46231] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 04:10:24,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-18 04:10:24,947 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46231] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-18 04:10:24,960 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-18 04:10:24,961 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-18 04:10:24,971 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-18 04:10:24,971 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-18 04:10:24,985 DEBUG [RS:1;jenkins-hbase4:42889] regionserver.HRegionServer(2830): Master is not running yet 2023-07-18 04:10:24,985 WARN [RS:1;jenkins-hbase4:42889] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-18 04:10:24,990 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689653424976,5,FailOnTimeoutGroup] 2023-07-18 04:10:24,994 DEBUG [RS:0;jenkins-hbase4:35525] regionserver.HRegionServer(2830): Master is not running yet 2023-07-18 04:10:24,994 DEBUG [RS:2;jenkins-hbase4:43385] regionserver.HRegionServer(2830): Master is not running yet 2023-07-18 04:10:24,995 WARN [RS:0;jenkins-hbase4:35525] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-18 04:10:24,995 WARN [RS:2;jenkins-hbase4:43385] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-18 04:10:24,997 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689653424990,5,FailOnTimeoutGroup] 2023-07-18 04:10:24,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:24,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-18 04:10:25,000 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:25,000 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:25,024 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-18 04:10:25,025 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-18 04:10:25,025 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8 2023-07-18 04:10:25,063 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:10:25,067 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-18 04:10:25,070 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/meta/1588230740/info 2023-07-18 04:10:25,072 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-18 04:10:25,074 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:10:25,074 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-18 04:10:25,077 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/meta/1588230740/rep_barrier 2023-07-18 04:10:25,078 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-18 04:10:25,079 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:10:25,079 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-18 04:10:25,082 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/meta/1588230740/table 2023-07-18 04:10:25,082 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-18 04:10:25,083 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:10:25,086 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/meta/1588230740 2023-07-18 04:10:25,087 INFO [RS:1;jenkins-hbase4:42889] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46231,1689653421609 with isa=jenkins-hbase4.apache.org/172.31.14.131:42889, startcode=1689653423206 2023-07-18 04:10:25,088 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/meta/1588230740 2023-07-18 04:10:25,095 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-18 04:10:25,097 INFO [RS:0;jenkins-hbase4:35525] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46231,1689653421609 with isa=jenkins-hbase4.apache.org/172.31.14.131:35525, startcode=1689653423141 2023-07-18 04:10:25,099 INFO [RS:2;jenkins-hbase4:43385] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,46231,1689653421609 with isa=jenkins-hbase4.apache.org/172.31.14.131:43385, startcode=1689653423267 2023-07-18 04:10:25,100 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46231] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:25,103 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-18 04:10:25,111 DEBUG [RS:1;jenkins-hbase4:42889] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8 2023-07-18 04:10:25,111 DEBUG [RS:1;jenkins-hbase4:42889] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:43229 2023-07-18 04:10:25,111 DEBUG [RS:1;jenkins-hbase4:42889] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-18 04:10:25,112 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46231] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:25,113 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46231] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:25,127 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 04:10:25,129 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 04:10:25,130 DEBUG [RS:2;jenkins-hbase4:43385] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8 2023-07-18 04:10:25,130 DEBUG [RS:2;jenkins-hbase4:43385] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:43229 2023-07-18 04:10:25,130 DEBUG [RS:2;jenkins-hbase4:43385] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-18 04:10:25,130 DEBUG [RS:1;jenkins-hbase4:42889] zookeeper.ZKUtil(162): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:25,130 DEBUG [RS:0;jenkins-hbase4:35525] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8 2023-07-18 04:10:25,130 WARN [RS:1;jenkins-hbase4:42889] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-18 04:10:25,130 DEBUG [RS:0;jenkins-hbase4:35525] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:43229 2023-07-18 04:10:25,131 INFO [RS:1;jenkins-hbase4:42889] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 04:10:25,131 DEBUG [RS:0;jenkins-hbase4:35525] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-18 04:10:25,131 DEBUG [RS:1;jenkins-hbase4:42889] regionserver.HRegionServer(1948): logDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/WALs/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:25,136 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65904466, jitterRate=-0.01794692873954773}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-18 04:10:25,136 DEBUG [RS:0;jenkins-hbase4:35525] zookeeper.ZKUtil(162): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:25,137 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-18 04:10:25,137 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-18 04:10:25,137 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-18 04:10:25,137 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-18 04:10:25,137 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-18 04:10:25,137 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-18 04:10:25,137 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42889,1689653423206] 2023-07-18 04:10:25,137 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35525,1689653423141] 2023-07-18 04:10:25,137 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43385,1689653423267] 2023-07-18 04:10:25,136 WARN [RS:0;jenkins-hbase4:35525] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-18 04:10:25,138 INFO [RS:0;jenkins-hbase4:35525] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 04:10:25,138 DEBUG [RS:2;jenkins-hbase4:43385] zookeeper.ZKUtil(162): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:25,138 DEBUG [RS:0;jenkins-hbase4:35525] regionserver.HRegionServer(1948): logDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/WALs/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:25,139 WARN [RS:2;jenkins-hbase4:43385] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-18 04:10:25,139 INFO [RS:2;jenkins-hbase4:43385] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 04:10:25,139 DEBUG [RS:2;jenkins-hbase4:43385] regionserver.HRegionServer(1948): logDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/WALs/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:25,152 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-18 04:10:25,152 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-18 04:10:25,160 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-18 04:10:25,160 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-18 04:10:25,169 DEBUG [RS:2;jenkins-hbase4:43385] zookeeper.ZKUtil(162): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:25,169 DEBUG [RS:0;jenkins-hbase4:35525] zookeeper.ZKUtil(162): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:25,170 DEBUG [RS:2;jenkins-hbase4:43385] zookeeper.ZKUtil(162): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:25,170 DEBUG [RS:0;jenkins-hbase4:35525] zookeeper.ZKUtil(162): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:25,170 DEBUG [RS:1;jenkins-hbase4:42889] zookeeper.ZKUtil(162): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:25,171 DEBUG [RS:2;jenkins-hbase4:43385] zookeeper.ZKUtil(162): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:25,171 DEBUG [RS:0;jenkins-hbase4:35525] zookeeper.ZKUtil(162): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:25,171 DEBUG [RS:1;jenkins-hbase4:42889] zookeeper.ZKUtil(162): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:25,172 DEBUG [RS:1;jenkins-hbase4:42889] zookeeper.ZKUtil(162): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:25,177 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-18 04:10:25,187 DEBUG [RS:1;jenkins-hbase4:42889] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-18 04:10:25,187 DEBUG [RS:2;jenkins-hbase4:43385] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-18 04:10:25,188 DEBUG [RS:0;jenkins-hbase4:35525] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-18 04:10:25,195 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-18 04:10:25,198 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-18 04:10:25,203 INFO [RS:0;jenkins-hbase4:35525] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-18 04:10:25,203 INFO [RS:1;jenkins-hbase4:42889] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-18 04:10:25,203 INFO [RS:2;jenkins-hbase4:43385] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-18 04:10:25,242 INFO [RS:2;jenkins-hbase4:43385] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-18 04:10:25,243 INFO [RS:1;jenkins-hbase4:42889] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-18 04:10:25,243 INFO [RS:0;jenkins-hbase4:35525] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-18 04:10:25,250 INFO [RS:1;jenkins-hbase4:42889] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-18 04:10:25,250 INFO [RS:1;jenkins-hbase4:42889] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:25,250 INFO [RS:1;jenkins-hbase4:42889] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-18 04:10:25,255 INFO [RS:0;jenkins-hbase4:35525] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-18 04:10:25,257 INFO [RS:2;jenkins-hbase4:43385] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-18 04:10:25,265 INFO [RS:0;jenkins-hbase4:35525] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:25,265 INFO [RS:2;jenkins-hbase4:43385] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:25,270 INFO [RS:0;jenkins-hbase4:35525] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-18 04:10:25,278 INFO [RS:2;jenkins-hbase4:43385] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-18 04:10:25,281 INFO [RS:0;jenkins-hbase4:35525] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:25,282 DEBUG [RS:0;jenkins-hbase4:35525] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,282 DEBUG [RS:0;jenkins-hbase4:35525] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,282 DEBUG [RS:0;jenkins-hbase4:35525] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,282 DEBUG [RS:0;jenkins-hbase4:35525] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,282 DEBUG [RS:0;jenkins-hbase4:35525] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,282 DEBUG [RS:0;jenkins-hbase4:35525] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-18 04:10:25,282 DEBUG [RS:0;jenkins-hbase4:35525] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,282 DEBUG [RS:0;jenkins-hbase4:35525] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,282 DEBUG [RS:0;jenkins-hbase4:35525] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,283 DEBUG [RS:0;jenkins-hbase4:35525] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,286 INFO [RS:1;jenkins-hbase4:42889] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:25,290 INFO [RS:2;jenkins-hbase4:43385] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:25,291 DEBUG [RS:2;jenkins-hbase4:43385] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,291 DEBUG [RS:2;jenkins-hbase4:43385] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,290 DEBUG [RS:1;jenkins-hbase4:42889] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,291 DEBUG [RS:2;jenkins-hbase4:43385] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,291 DEBUG [RS:1;jenkins-hbase4:42889] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,291 DEBUG [RS:2;jenkins-hbase4:43385] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,291 DEBUG [RS:1;jenkins-hbase4:42889] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,291 DEBUG [RS:2;jenkins-hbase4:43385] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,291 DEBUG [RS:1;jenkins-hbase4:42889] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,292 DEBUG [RS:2;jenkins-hbase4:43385] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-18 04:10:25,292 DEBUG [RS:1;jenkins-hbase4:42889] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,291 INFO [RS:0;jenkins-hbase4:35525] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:25,292 DEBUG [RS:2;jenkins-hbase4:43385] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,292 DEBUG [RS:2;jenkins-hbase4:43385] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,292 DEBUG [RS:1;jenkins-hbase4:42889] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-18 04:10:25,292 DEBUG [RS:2;jenkins-hbase4:43385] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,292 DEBUG [RS:1;jenkins-hbase4:42889] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,292 DEBUG [RS:2;jenkins-hbase4:43385] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,293 DEBUG [RS:1;jenkins-hbase4:42889] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,292 INFO [RS:0;jenkins-hbase4:35525] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:25,293 DEBUG [RS:1;jenkins-hbase4:42889] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,293 INFO [RS:0;jenkins-hbase4:35525] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:25,293 DEBUG [RS:1;jenkins-hbase4:42889] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 04:10:25,318 INFO [RS:1;jenkins-hbase4:42889] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:25,319 INFO [RS:1;jenkins-hbase4:42889] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:25,319 INFO [RS:1;jenkins-hbase4:42889] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:25,332 INFO [RS:2;jenkins-hbase4:43385] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:25,332 INFO [RS:2;jenkins-hbase4:43385] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:25,332 INFO [RS:2;jenkins-hbase4:43385] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:25,333 INFO [RS:0;jenkins-hbase4:35525] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-18 04:10:25,337 INFO [RS:0;jenkins-hbase4:35525] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35525,1689653423141-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:25,351 DEBUG [jenkins-hbase4:46231] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-18 04:10:25,348 INFO [RS:2;jenkins-hbase4:43385] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-18 04:10:25,359 INFO [RS:2;jenkins-hbase4:43385] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43385,1689653423267-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:25,368 DEBUG [jenkins-hbase4:46231] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 04:10:25,381 DEBUG [jenkins-hbase4:46231] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 04:10:25,381 DEBUG [jenkins-hbase4:46231] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 04:10:25,381 DEBUG [jenkins-hbase4:46231] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 04:10:25,381 DEBUG [jenkins-hbase4:46231] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 04:10:25,387 INFO [RS:0;jenkins-hbase4:35525] regionserver.Replication(203): jenkins-hbase4.apache.org,35525,1689653423141 started 2023-07-18 04:10:25,387 INFO [RS:0;jenkins-hbase4:35525] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,35525,1689653423141, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35525, sessionid=0x101769fa5910001 2023-07-18 04:10:25,388 DEBUG [RS:0;jenkins-hbase4:35525] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-18 04:10:25,388 DEBUG [RS:0;jenkins-hbase4:35525] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:25,388 DEBUG [RS:0;jenkins-hbase4:35525] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35525,1689653423141' 2023-07-18 04:10:25,388 DEBUG [RS:0;jenkins-hbase4:35525] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-18 04:10:25,389 DEBUG [RS:0;jenkins-hbase4:35525] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-18 04:10:25,390 DEBUG [RS:0;jenkins-hbase4:35525] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-18 04:10:25,390 DEBUG [RS:0;jenkins-hbase4:35525] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-18 04:10:25,390 DEBUG [RS:0;jenkins-hbase4:35525] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:25,390 DEBUG [RS:0;jenkins-hbase4:35525] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35525,1689653423141' 2023-07-18 04:10:25,390 DEBUG [RS:0;jenkins-hbase4:35525] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:25,391 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43385,1689653423267, state=OPENING 2023-07-18 04:10:25,391 DEBUG [RS:0;jenkins-hbase4:35525] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:25,392 DEBUG [RS:0;jenkins-hbase4:35525] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-18 04:10:25,392 INFO [RS:0;jenkins-hbase4:35525] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-18 04:10:25,392 INFO [RS:0;jenkins-hbase4:35525] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-18 04:10:25,397 INFO [RS:2;jenkins-hbase4:43385] regionserver.Replication(203): jenkins-hbase4.apache.org,43385,1689653423267 started 2023-07-18 04:10:25,397 INFO [RS:2;jenkins-hbase4:43385] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,43385,1689653423267, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43385, sessionid=0x101769fa5910003 2023-07-18 04:10:25,397 INFO [RS:1;jenkins-hbase4:42889] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-18 04:10:25,397 DEBUG [RS:2;jenkins-hbase4:43385] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-18 04:10:25,397 INFO [RS:1;jenkins-hbase4:42889] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42889,1689653423206-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:25,397 DEBUG [RS:2;jenkins-hbase4:43385] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:25,401 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-18 04:10:25,403 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 04:10:25,404 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-18 04:10:25,398 DEBUG [RS:2;jenkins-hbase4:43385] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43385,1689653423267' 2023-07-18 04:10:25,423 DEBUG [RS:2;jenkins-hbase4:43385] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-18 04:10:25,410 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43385,1689653423267}] 2023-07-18 04:10:25,424 DEBUG [RS:2;jenkins-hbase4:43385] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-18 04:10:25,431 DEBUG [RS:2;jenkins-hbase4:43385] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-18 04:10:25,431 DEBUG [RS:2;jenkins-hbase4:43385] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-18 04:10:25,431 INFO [RS:1;jenkins-hbase4:42889] regionserver.Replication(203): jenkins-hbase4.apache.org,42889,1689653423206 started 2023-07-18 04:10:25,432 INFO [RS:1;jenkins-hbase4:42889] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,42889,1689653423206, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42889, sessionid=0x101769fa5910002 2023-07-18 04:10:25,432 DEBUG [RS:1;jenkins-hbase4:42889] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-18 04:10:25,432 DEBUG [RS:1;jenkins-hbase4:42889] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:25,432 DEBUG [RS:1;jenkins-hbase4:42889] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42889,1689653423206' 2023-07-18 04:10:25,432 DEBUG [RS:1;jenkins-hbase4:42889] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-18 04:10:25,433 DEBUG [RS:1;jenkins-hbase4:42889] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-18 04:10:25,431 DEBUG [RS:2;jenkins-hbase4:43385] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:25,434 DEBUG [RS:2;jenkins-hbase4:43385] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43385,1689653423267' 2023-07-18 04:10:25,434 DEBUG [RS:2;jenkins-hbase4:43385] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:25,435 DEBUG [RS:2;jenkins-hbase4:43385] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:25,435 DEBUG [RS:1;jenkins-hbase4:42889] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-18 04:10:25,435 DEBUG [RS:1;jenkins-hbase4:42889] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-18 04:10:25,436 DEBUG [RS:1;jenkins-hbase4:42889] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:25,436 DEBUG [RS:1;jenkins-hbase4:42889] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42889,1689653423206' 2023-07-18 04:10:25,436 DEBUG [RS:1;jenkins-hbase4:42889] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:25,436 DEBUG [RS:2;jenkins-hbase4:43385] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-18 04:10:25,436 INFO [RS:2;jenkins-hbase4:43385] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-18 04:10:25,437 INFO [RS:2;jenkins-hbase4:43385] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-18 04:10:25,438 DEBUG [RS:1;jenkins-hbase4:42889] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:25,439 DEBUG [RS:1;jenkins-hbase4:42889] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-18 04:10:25,439 INFO [RS:1;jenkins-hbase4:42889] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-18 04:10:25,439 INFO [RS:1;jenkins-hbase4:42889] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-18 04:10:25,503 INFO [RS:0;jenkins-hbase4:35525] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35525%2C1689653423141, suffix=, logDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/WALs/jenkins-hbase4.apache.org,35525,1689653423141, archiveDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/oldWALs, maxLogs=32 2023-07-18 04:10:25,524 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38543,DS-fcfa53cf-cafc-4864-8e88-e4d248c589f9,DISK] 2023-07-18 04:10:25,524 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46683,DS-7eea9563-e4ce-4ba7-941d-1b47c3119829,DISK] 2023-07-18 04:10:25,525 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36843,DS-7f052418-6e23-403c-a0b3-1b3a2d5b1c00,DISK] 2023-07-18 04:10:25,529 INFO [RS:0;jenkins-hbase4:35525] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/WALs/jenkins-hbase4.apache.org,35525,1689653423141/jenkins-hbase4.apache.org%2C35525%2C1689653423141.1689653425505 2023-07-18 04:10:25,529 DEBUG [RS:0;jenkins-hbase4:35525] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38543,DS-fcfa53cf-cafc-4864-8e88-e4d248c589f9,DISK], DatanodeInfoWithStorage[127.0.0.1:46683,DS-7eea9563-e4ce-4ba7-941d-1b47c3119829,DISK], DatanodeInfoWithStorage[127.0.0.1:36843,DS-7f052418-6e23-403c-a0b3-1b3a2d5b1c00,DISK]] 2023-07-18 04:10:25,547 INFO [RS:2;jenkins-hbase4:43385] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43385%2C1689653423267, suffix=, logDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/WALs/jenkins-hbase4.apache.org,43385,1689653423267, archiveDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/oldWALs, maxLogs=32 2023-07-18 04:10:25,547 INFO [RS:1;jenkins-hbase4:42889] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42889%2C1689653423206, suffix=, logDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/WALs/jenkins-hbase4.apache.org,42889,1689653423206, archiveDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/oldWALs, maxLogs=32 2023-07-18 04:10:25,586 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46683,DS-7eea9563-e4ce-4ba7-941d-1b47c3119829,DISK] 2023-07-18 04:10:25,588 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36843,DS-7f052418-6e23-403c-a0b3-1b3a2d5b1c00,DISK] 2023-07-18 04:10:25,588 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38543,DS-fcfa53cf-cafc-4864-8e88-e4d248c589f9,DISK] 2023-07-18 04:10:25,621 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46683,DS-7eea9563-e4ce-4ba7-941d-1b47c3119829,DISK] 2023-07-18 04:10:25,625 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36843,DS-7f052418-6e23-403c-a0b3-1b3a2d5b1c00,DISK] 2023-07-18 04:10:25,665 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38543,DS-fcfa53cf-cafc-4864-8e88-e4d248c589f9,DISK] 2023-07-18 04:10:25,673 INFO [RS:1;jenkins-hbase4:42889] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/WALs/jenkins-hbase4.apache.org,42889,1689653423206/jenkins-hbase4.apache.org%2C42889%2C1689653423206.1689653425551 2023-07-18 04:10:25,673 INFO [RS:2;jenkins-hbase4:43385] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/WALs/jenkins-hbase4.apache.org,43385,1689653423267/jenkins-hbase4.apache.org%2C43385%2C1689653423267.1689653425551 2023-07-18 04:10:25,677 DEBUG [RS:1;jenkins-hbase4:42889] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46683,DS-7eea9563-e4ce-4ba7-941d-1b47c3119829,DISK], DatanodeInfoWithStorage[127.0.0.1:36843,DS-7f052418-6e23-403c-a0b3-1b3a2d5b1c00,DISK], DatanodeInfoWithStorage[127.0.0.1:38543,DS-fcfa53cf-cafc-4864-8e88-e4d248c589f9,DISK]] 2023-07-18 04:10:25,677 DEBUG [RS:2;jenkins-hbase4:43385] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46683,DS-7eea9563-e4ce-4ba7-941d-1b47c3119829,DISK], DatanodeInfoWithStorage[127.0.0.1:36843,DS-7f052418-6e23-403c-a0b3-1b3a2d5b1c00,DISK], DatanodeInfoWithStorage[127.0.0.1:38543,DS-fcfa53cf-cafc-4864-8e88-e4d248c589f9,DISK]] 2023-07-18 04:10:25,692 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:25,695 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 04:10:25,698 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55822, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 04:10:25,714 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-18 04:10:25,715 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 04:10:25,720 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43385%2C1689653423267.meta, suffix=.meta, logDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/WALs/jenkins-hbase4.apache.org,43385,1689653423267, archiveDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/oldWALs, maxLogs=32 2023-07-18 04:10:25,754 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38543,DS-fcfa53cf-cafc-4864-8e88-e4d248c589f9,DISK] 2023-07-18 04:10:25,756 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36843,DS-7f052418-6e23-403c-a0b3-1b3a2d5b1c00,DISK] 2023-07-18 04:10:25,757 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46683,DS-7eea9563-e4ce-4ba7-941d-1b47c3119829,DISK] 2023-07-18 04:10:25,768 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/WALs/jenkins-hbase4.apache.org,43385,1689653423267/jenkins-hbase4.apache.org%2C43385%2C1689653423267.meta.1689653425722.meta 2023-07-18 04:10:25,769 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38543,DS-fcfa53cf-cafc-4864-8e88-e4d248c589f9,DISK], DatanodeInfoWithStorage[127.0.0.1:36843,DS-7f052418-6e23-403c-a0b3-1b3a2d5b1c00,DISK], DatanodeInfoWithStorage[127.0.0.1:46683,DS-7eea9563-e4ce-4ba7-941d-1b47c3119829,DISK]] 2023-07-18 04:10:25,769 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-18 04:10:25,771 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-18 04:10:25,773 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:10:25,774 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-18 04:10:25,777 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-18 04:10:25,779 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-18 04:10:25,801 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-18 04:10:25,801 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:10:25,801 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-18 04:10:25,801 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-18 04:10:25,805 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-18 04:10:25,807 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/meta/1588230740/info 2023-07-18 04:10:25,807 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/meta/1588230740/info 2023-07-18 04:10:25,807 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-18 04:10:25,808 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:10:25,808 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-18 04:10:25,810 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/meta/1588230740/rep_barrier 2023-07-18 04:10:25,810 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/meta/1588230740/rep_barrier 2023-07-18 04:10:25,811 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-18 04:10:25,812 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:10:25,812 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-18 04:10:25,814 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/meta/1588230740/table 2023-07-18 04:10:25,814 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/meta/1588230740/table 2023-07-18 04:10:25,814 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-18 04:10:25,815 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:10:25,817 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/meta/1588230740 2023-07-18 04:10:25,821 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/meta/1588230740 2023-07-18 04:10:25,825 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-18 04:10:25,828 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-18 04:10:25,830 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68708419, jitterRate=0.023835226893424988}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-18 04:10:25,832 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-18 04:10:25,842 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689653425677 2023-07-18 04:10:25,863 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-18 04:10:25,864 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-18 04:10:25,864 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43385,1689653423267, state=OPEN 2023-07-18 04:10:25,868 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-18 04:10:25,868 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-18 04:10:25,873 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-18 04:10:25,873 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43385,1689653423267 in 458 msec 2023-07-18 04:10:25,880 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-18 04:10:25,880 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 698 msec 2023-07-18 04:10:25,886 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1770 sec 2023-07-18 04:10:25,887 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689653425886, completionTime=-1 2023-07-18 04:10:25,887 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-18 04:10:25,887 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-18 04:10:25,975 DEBUG [hconnection-0xf2856f0-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:10:25,983 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55838, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:10:26,019 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-18 04:10:26,020 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689653486020 2023-07-18 04:10:26,020 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689653546020 2023-07-18 04:10:26,020 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 133 msec 2023-07-18 04:10:26,047 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46231,1689653421609-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:26,047 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46231,1689653421609-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:26,047 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46231,1689653421609-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:26,049 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:46231, period=300000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:26,050 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-18 04:10:26,060 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-18 04:10:26,067 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-18 04:10:26,069 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-18 04:10:26,082 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-18 04:10:26,086 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 04:10:26,090 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 04:10:26,124 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/hbase/namespace/104dd5cf9dea83884c2dad25eb49b80e 2023-07-18 04:10:26,127 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/hbase/namespace/104dd5cf9dea83884c2dad25eb49b80e empty. 2023-07-18 04:10:26,128 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/hbase/namespace/104dd5cf9dea83884c2dad25eb49b80e 2023-07-18 04:10:26,128 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-18 04:10:26,177 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-18 04:10:26,180 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 104dd5cf9dea83884c2dad25eb49b80e, NAME => 'hbase:namespace,,1689653426068.104dd5cf9dea83884c2dad25eb49b80e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp 2023-07-18 04:10:26,216 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689653426068.104dd5cf9dea83884c2dad25eb49b80e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:10:26,216 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 104dd5cf9dea83884c2dad25eb49b80e, disabling compactions & flushes 2023-07-18 04:10:26,216 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689653426068.104dd5cf9dea83884c2dad25eb49b80e. 2023-07-18 04:10:26,216 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689653426068.104dd5cf9dea83884c2dad25eb49b80e. 2023-07-18 04:10:26,216 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689653426068.104dd5cf9dea83884c2dad25eb49b80e. after waiting 0 ms 2023-07-18 04:10:26,216 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689653426068.104dd5cf9dea83884c2dad25eb49b80e. 2023-07-18 04:10:26,216 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689653426068.104dd5cf9dea83884c2dad25eb49b80e. 2023-07-18 04:10:26,216 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 104dd5cf9dea83884c2dad25eb49b80e: 2023-07-18 04:10:26,222 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 04:10:26,244 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689653426068.104dd5cf9dea83884c2dad25eb49b80e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689653426226"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653426226"}]},"ts":"1689653426226"} 2023-07-18 04:10:26,278 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-18 04:10:26,280 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 04:10:26,286 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653426280"}]},"ts":"1689653426280"} 2023-07-18 04:10:26,293 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-18 04:10:26,301 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 04:10:26,302 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 04:10:26,303 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 04:10:26,303 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 04:10:26,303 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 04:10:26,306 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=104dd5cf9dea83884c2dad25eb49b80e, ASSIGN}] 2023-07-18 04:10:26,310 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=104dd5cf9dea83884c2dad25eb49b80e, ASSIGN 2023-07-18 04:10:26,316 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=104dd5cf9dea83884c2dad25eb49b80e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42889,1689653423206; forceNewPlan=false, retain=false 2023-07-18 04:10:26,469 INFO [jenkins-hbase4:46231] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-18 04:10:26,470 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=104dd5cf9dea83884c2dad25eb49b80e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:26,471 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689653426068.104dd5cf9dea83884c2dad25eb49b80e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689653426470"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653426470"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653426470"}]},"ts":"1689653426470"} 2023-07-18 04:10:26,479 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 104dd5cf9dea83884c2dad25eb49b80e, server=jenkins-hbase4.apache.org,42889,1689653423206}] 2023-07-18 04:10:26,635 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:26,636 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 04:10:26,639 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47446, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 04:10:26,646 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689653426068.104dd5cf9dea83884c2dad25eb49b80e. 2023-07-18 04:10:26,646 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 104dd5cf9dea83884c2dad25eb49b80e, NAME => 'hbase:namespace,,1689653426068.104dd5cf9dea83884c2dad25eb49b80e.', STARTKEY => '', ENDKEY => ''} 2023-07-18 04:10:26,647 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689653426068.104dd5cf9dea83884c2dad25eb49b80e. service=AccessControlService 2023-07-18 04:10:26,647 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:10:26,648 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 104dd5cf9dea83884c2dad25eb49b80e 2023-07-18 04:10:26,648 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689653426068.104dd5cf9dea83884c2dad25eb49b80e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:10:26,648 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 104dd5cf9dea83884c2dad25eb49b80e 2023-07-18 04:10:26,648 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 104dd5cf9dea83884c2dad25eb49b80e 2023-07-18 04:10:26,651 INFO [StoreOpener-104dd5cf9dea83884c2dad25eb49b80e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 104dd5cf9dea83884c2dad25eb49b80e 2023-07-18 04:10:26,653 DEBUG [StoreOpener-104dd5cf9dea83884c2dad25eb49b80e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/namespace/104dd5cf9dea83884c2dad25eb49b80e/info 2023-07-18 04:10:26,653 DEBUG [StoreOpener-104dd5cf9dea83884c2dad25eb49b80e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/namespace/104dd5cf9dea83884c2dad25eb49b80e/info 2023-07-18 04:10:26,654 INFO [StoreOpener-104dd5cf9dea83884c2dad25eb49b80e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 104dd5cf9dea83884c2dad25eb49b80e columnFamilyName info 2023-07-18 04:10:26,655 INFO [StoreOpener-104dd5cf9dea83884c2dad25eb49b80e-1] regionserver.HStore(310): Store=104dd5cf9dea83884c2dad25eb49b80e/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:10:26,658 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/namespace/104dd5cf9dea83884c2dad25eb49b80e 2023-07-18 04:10:26,659 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/namespace/104dd5cf9dea83884c2dad25eb49b80e 2023-07-18 04:10:26,663 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 104dd5cf9dea83884c2dad25eb49b80e 2023-07-18 04:10:26,667 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/namespace/104dd5cf9dea83884c2dad25eb49b80e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 04:10:26,668 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 104dd5cf9dea83884c2dad25eb49b80e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71127117, jitterRate=0.059876635670661926}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 04:10:26,668 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 104dd5cf9dea83884c2dad25eb49b80e: 2023-07-18 04:10:26,670 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689653426068.104dd5cf9dea83884c2dad25eb49b80e., pid=6, masterSystemTime=1689653426635 2023-07-18 04:10:26,675 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689653426068.104dd5cf9dea83884c2dad25eb49b80e. 2023-07-18 04:10:26,677 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689653426068.104dd5cf9dea83884c2dad25eb49b80e. 2023-07-18 04:10:26,678 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=104dd5cf9dea83884c2dad25eb49b80e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:26,678 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689653426068.104dd5cf9dea83884c2dad25eb49b80e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689653426677"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689653426677"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689653426677"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689653426677"}]},"ts":"1689653426677"} 2023-07-18 04:10:26,687 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-18 04:10:26,687 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 104dd5cf9dea83884c2dad25eb49b80e, server=jenkins-hbase4.apache.org,42889,1689653423206 in 203 msec 2023-07-18 04:10:26,692 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-18 04:10:26,692 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=104dd5cf9dea83884c2dad25eb49b80e, ASSIGN in 381 msec 2023-07-18 04:10:26,694 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 04:10:26,694 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653426694"}]},"ts":"1689653426694"} 2023-07-18 04:10:26,696 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-18 04:10:26,700 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 04:10:26,702 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 630 msec 2023-07-18 04:10:26,786 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-18 04:10:26,787 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-18 04:10:26,787 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 04:10:26,810 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:10:26,813 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47460, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:10:26,864 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-18 04:10:26,885 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-18 04:10:26,893 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 38 msec 2023-07-18 04:10:26,897 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-18 04:10:26,912 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-18 04:10:26,918 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 19 msec 2023-07-18 04:10:26,935 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-18 04:10:26,938 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-18 04:10:26,938 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.563sec 2023-07-18 04:10:26,941 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-18 04:10:26,943 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-18 04:10:26,943 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-18 04:10:26,944 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46231,1689653421609-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-18 04:10:26,945 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46231,1689653421609-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-18 04:10:26,951 DEBUG [Listener at localhost/38339] zookeeper.ReadOnlyZKClient(139): Connect 0x4cd4fb6c to 127.0.0.1:64260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:10:26,967 DEBUG [Listener at localhost/38339] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33afdcd8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:10:26,972 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-18 04:10:26,975 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-18 04:10:26,980 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 04:10:26,982 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 04:10:26,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-18 04:10:26,991 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/hbase/acl/c19f69e100a1c0c78ad29cf77fb8f117 2023-07-18 04:10:26,991 DEBUG [hconnection-0x1ab66b66-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:10:26,992 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/hbase/acl/c19f69e100a1c0c78ad29cf77fb8f117 empty. 2023-07-18 04:10:26,996 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-18 04:10:27,001 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/hbase/acl/c19f69e100a1c0c78ad29cf77fb8f117 2023-07-18 04:10:27,001 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-18 04:10:27,016 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55848, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:10:27,019 INFO [Listener at localhost/38339] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,46231,1689653421609 2023-07-18 04:10:27,019 INFO [Listener at localhost/38339] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-18 04:10:27,019 INFO [Listener at localhost/38339] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/test.cache.data in system properties and HBase conf 2023-07-18 04:10:27,019 INFO [Listener at localhost/38339] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/hadoop.tmp.dir in system properties and HBase conf 2023-07-18 04:10:27,019 INFO [Listener at localhost/38339] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/hadoop.log.dir in system properties and HBase conf 2023-07-18 04:10:27,020 INFO [Listener at localhost/38339] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-18 04:10:27,020 INFO [Listener at localhost/38339] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-18 04:10:27,020 INFO [Listener at localhost/38339] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-18 04:10:27,020 INFO [Listener at localhost/38339] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-18 04:10:27,020 INFO [Listener at localhost/38339] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-18 04:10:27,021 INFO [Listener at localhost/38339] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-18 04:10:27,021 INFO [Listener at localhost/38339] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-18 04:10:27,021 INFO [Listener at localhost/38339] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-18 04:10:27,022 INFO [Listener at localhost/38339] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-18 04:10:27,022 INFO [Listener at localhost/38339] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-18 04:10:27,022 INFO [Listener at localhost/38339] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-18 04:10:27,022 INFO [Listener at localhost/38339] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-18 04:10:27,024 INFO [Listener at localhost/38339] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/nfs.dump.dir in system properties and HBase conf 2023-07-18 04:10:27,024 INFO [Listener at localhost/38339] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/java.io.tmpdir in system properties and HBase conf 2023-07-18 04:10:27,024 INFO [Listener at localhost/38339] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-18 04:10:27,025 INFO [Listener at localhost/38339] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-18 04:10:27,025 INFO [Listener at localhost/38339] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-18 04:10:27,033 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-18 04:10:27,035 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => c19f69e100a1c0c78ad29cf77fb8f117, NAME => 'hbase:acl,,1689653426966.c19f69e100a1c0c78ad29cf77fb8f117.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp 2023-07-18 04:10:27,066 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689653426966.c19f69e100a1c0c78ad29cf77fb8f117.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:10:27,066 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing c19f69e100a1c0c78ad29cf77fb8f117, disabling compactions & flushes 2023-07-18 04:10:27,066 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689653426966.c19f69e100a1c0c78ad29cf77fb8f117. 2023-07-18 04:10:27,066 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689653426966.c19f69e100a1c0c78ad29cf77fb8f117. 2023-07-18 04:10:27,067 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689653426966.c19f69e100a1c0c78ad29cf77fb8f117. after waiting 0 ms 2023-07-18 04:10:27,067 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689653426966.c19f69e100a1c0c78ad29cf77fb8f117. 2023-07-18 04:10:27,067 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689653426966.c19f69e100a1c0c78ad29cf77fb8f117. 2023-07-18 04:10:27,067 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for c19f69e100a1c0c78ad29cf77fb8f117: 2023-07-18 04:10:27,082 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 04:10:27,084 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689653426966.c19f69e100a1c0c78ad29cf77fb8f117.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689653427084"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653427084"}]},"ts":"1689653427084"} 2023-07-18 04:10:27,090 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-18 04:10:27,091 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 04:10:27,092 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653427091"}]},"ts":"1689653427091"} 2023-07-18 04:10:27,094 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-18 04:10:27,100 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-18 04:10:27,101 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 04:10:27,102 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 04:10:27,102 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 04:10:27,102 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 04:10:27,102 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 04:10:27,103 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=c19f69e100a1c0c78ad29cf77fb8f117, ASSIGN}] 2023-07-18 04:10:27,117 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=c19f69e100a1c0c78ad29cf77fb8f117, ASSIGN 2023-07-18 04:10:27,124 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=c19f69e100a1c0c78ad29cf77fb8f117, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35525,1689653423141; forceNewPlan=false, retain=false 2023-07-18 04:10:27,275 INFO [jenkins-hbase4:46231] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-18 04:10:27,276 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=c19f69e100a1c0c78ad29cf77fb8f117, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:27,277 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689653426966.c19f69e100a1c0c78ad29cf77fb8f117.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689653427276"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653427276"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653427276"}]},"ts":"1689653427276"} 2023-07-18 04:10:27,283 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure c19f69e100a1c0c78ad29cf77fb8f117, server=jenkins-hbase4.apache.org,35525,1689653423141}] 2023-07-18 04:10:27,300 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-18 04:10:27,439 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:27,439 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 04:10:27,443 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44498, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 04:10:27,450 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689653426966.c19f69e100a1c0c78ad29cf77fb8f117. 2023-07-18 04:10:27,451 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c19f69e100a1c0c78ad29cf77fb8f117, NAME => 'hbase:acl,,1689653426966.c19f69e100a1c0c78ad29cf77fb8f117.', STARTKEY => '', ENDKEY => ''} 2023-07-18 04:10:27,451 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689653426966.c19f69e100a1c0c78ad29cf77fb8f117. service=AccessControlService 2023-07-18 04:10:27,451 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:10:27,452 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl c19f69e100a1c0c78ad29cf77fb8f117 2023-07-18 04:10:27,452 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689653426966.c19f69e100a1c0c78ad29cf77fb8f117.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:10:27,452 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c19f69e100a1c0c78ad29cf77fb8f117 2023-07-18 04:10:27,452 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c19f69e100a1c0c78ad29cf77fb8f117 2023-07-18 04:10:27,455 INFO [StoreOpener-c19f69e100a1c0c78ad29cf77fb8f117-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region c19f69e100a1c0c78ad29cf77fb8f117 2023-07-18 04:10:27,458 DEBUG [StoreOpener-c19f69e100a1c0c78ad29cf77fb8f117-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/acl/c19f69e100a1c0c78ad29cf77fb8f117/l 2023-07-18 04:10:27,458 DEBUG [StoreOpener-c19f69e100a1c0c78ad29cf77fb8f117-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/acl/c19f69e100a1c0c78ad29cf77fb8f117/l 2023-07-18 04:10:27,458 INFO [StoreOpener-c19f69e100a1c0c78ad29cf77fb8f117-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c19f69e100a1c0c78ad29cf77fb8f117 columnFamilyName l 2023-07-18 04:10:27,459 INFO [StoreOpener-c19f69e100a1c0c78ad29cf77fb8f117-1] regionserver.HStore(310): Store=c19f69e100a1c0c78ad29cf77fb8f117/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:10:27,461 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/acl/c19f69e100a1c0c78ad29cf77fb8f117 2023-07-18 04:10:27,466 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/acl/c19f69e100a1c0c78ad29cf77fb8f117 2023-07-18 04:10:27,475 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c19f69e100a1c0c78ad29cf77fb8f117 2023-07-18 04:10:27,480 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/acl/c19f69e100a1c0c78ad29cf77fb8f117/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 04:10:27,481 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c19f69e100a1c0c78ad29cf77fb8f117; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62627741, jitterRate=-0.06677393615245819}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 04:10:27,481 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c19f69e100a1c0c78ad29cf77fb8f117: 2023-07-18 04:10:27,483 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689653426966.c19f69e100a1c0c78ad29cf77fb8f117., pid=11, masterSystemTime=1689653427439 2023-07-18 04:10:27,488 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689653426966.c19f69e100a1c0c78ad29cf77fb8f117. 2023-07-18 04:10:27,489 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689653426966.c19f69e100a1c0c78ad29cf77fb8f117. 2023-07-18 04:10:27,490 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=c19f69e100a1c0c78ad29cf77fb8f117, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:27,490 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689653426966.c19f69e100a1c0c78ad29cf77fb8f117.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689653427490"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689653427490"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689653427490"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689653427490"}]},"ts":"1689653427490"} 2023-07-18 04:10:27,500 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-18 04:10:27,500 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure c19f69e100a1c0c78ad29cf77fb8f117, server=jenkins-hbase4.apache.org,35525,1689653423141 in 211 msec 2023-07-18 04:10:27,504 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-18 04:10:27,504 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=c19f69e100a1c0c78ad29cf77fb8f117, ASSIGN in 398 msec 2023-07-18 04:10:27,505 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 04:10:27,506 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653427506"}]},"ts":"1689653427506"} 2023-07-18 04:10:27,508 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-18 04:10:27,512 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 04:10:27,518 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 540 msec 2023-07-18 04:10:27,600 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-18 04:10:27,601 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-18 04:10:27,634 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-18 04:10:28,385 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 04:10:28,678 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 04:10:28,683 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_38879_jobhistory____.4bv30i/webapp 2023-07-18 04:10:28,840 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-18 04:10:28,841 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-18 04:10:28,841 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-18 04:10:28,843 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-18 04:10:28,926 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 04:10:29,213 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 04:10:29,557 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-18 04:10:29,649 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:38879 2023-07-18 04:10:29,882 WARN [Listener at jenkins-hbase4.apache.org/33895] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 04:10:30,245 WARN [Listener at jenkins-hbase4.apache.org/33895] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-18 04:10:30,246 INFO [Listener at jenkins-hbase4.apache.org/33895] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 04:10:30,254 INFO [Listener at jenkins-hbase4.apache.org/33895] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35137_cluster____kxwykx/webapp 2023-07-18 04:10:30,346 INFO [Listener at jenkins-hbase4.apache.org/33895] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-18 04:10:30,346 INFO [Listener at jenkins-hbase4.apache.org/33895] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-18 04:10:30,346 INFO [Listener at jenkins-hbase4.apache.org/33895] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-18 04:10:30,347 INFO [Listener at jenkins-hbase4.apache.org/33895] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-18 04:10:30,359 INFO [Listener at jenkins-hbase4.apache.org/33895] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 04:10:30,574 INFO [Listener at jenkins-hbase4.apache.org/33895] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 04:10:30,669 INFO [Listener at jenkins-hbase4.apache.org/33895] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 04:10:30,680 INFO [Listener at jenkins-hbase4.apache.org/33895] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35137 2023-07-18 04:10:31,198 WARN [Listener at jenkins-hbase4.apache.org/33917] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 04:10:31,224 WARN [Listener at jenkins-hbase4.apache.org/33917] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-18 04:10:31,225 INFO [Listener at jenkins-hbase4.apache.org/33917] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 04:10:31,236 INFO [Listener at jenkins-hbase4.apache.org/33917] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_44847_node____lkwvp5/webapp 2023-07-18 04:10:31,291 INFO [Listener at jenkins-hbase4.apache.org/33917] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-18 04:10:31,291 INFO [Listener at jenkins-hbase4.apache.org/33917] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-18 04:10:31,291 INFO [Listener at jenkins-hbase4.apache.org/33917] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-18 04:10:31,291 INFO [Listener at jenkins-hbase4.apache.org/33917] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-18 04:10:31,302 INFO [Listener at jenkins-hbase4.apache.org/33917] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 04:10:31,327 INFO [Listener at jenkins-hbase4.apache.org/33917] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 04:10:31,401 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 04:10:31,436 INFO [Listener at jenkins-hbase4.apache.org/33917] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 04:10:31,454 INFO [Listener at jenkins-hbase4.apache.org/33917] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:44847 2023-07-18 04:10:31,557 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-18 04:10:31,559 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-18 04:10:31,560 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-18 04:10:31,765 WARN [Listener at jenkins-hbase4.apache.org/40435] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 04:10:31,772 WARN [Listener at jenkins-hbase4.apache.org/40435] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-18 04:10:31,773 INFO [Listener at jenkins-hbase4.apache.org/40435] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 04:10:31,779 INFO [Listener at jenkins-hbase4.apache.org/40435] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_39897_node____kuv59q/webapp 2023-07-18 04:10:31,780 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:10:31,781 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-18 04:10:31,781 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:10:31,781 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-18 04:10:31,782 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-18 04:10:31,782 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-18 04:10:31,782 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:10:31,782 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-18 04:10:31,782 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-18 04:10:31,782 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-18 04:10:31,847 INFO [Listener at jenkins-hbase4.apache.org/40435] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-18 04:10:31,847 INFO [Listener at jenkins-hbase4.apache.org/40435] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-18 04:10:31,848 INFO [Listener at jenkins-hbase4.apache.org/40435] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-18 04:10:31,848 INFO [Listener at jenkins-hbase4.apache.org/40435] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-18 04:10:31,858 INFO [Listener at jenkins-hbase4.apache.org/40435] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 04:10:31,878 INFO [Listener at jenkins-hbase4.apache.org/40435] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 04:10:31,965 INFO [Listener at jenkins-hbase4.apache.org/40435] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 04:10:31,987 INFO [Listener at jenkins-hbase4.apache.org/40435] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39897 2023-07-18 04:10:32,022 INFO [Listener at jenkins-hbase4.apache.org/40435] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-18 04:10:32,024 INFO [Listener at jenkins-hbase4.apache.org/40435] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 04:10:32,103 INFO [Listener at jenkins-hbase4.apache.org/40435] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=707, OpenFileDescriptor=905, MaxFileDescriptor=60000, SystemLoadAverage=227, ProcessCount=175, AvailableMemoryMB=4973 2023-07-18 04:10:32,104 WARN [Listener at jenkins-hbase4.apache.org/40435] hbase.ResourceChecker(130): Thread=707 is superior to 500 2023-07-18 04:10:32,123 DEBUG [Listener at jenkins-hbase4.apache.org/40435] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-18 04:10:32,144 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58602, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-18 04:10:32,155 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-18 04:10:32,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-18 04:10:32,168 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 04:10:32,170 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-18 04:10:32,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-18 04:10:32,180 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 04:10:32,186 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportWithTargetName/43d0301e9465c8dda9208ed57580fcbf 2023-07-18 04:10:32,190 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportWithTargetName/e227915d876324ca12228bbb45002eb3 2023-07-18 04:10:32,190 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportWithTargetName/43d0301e9465c8dda9208ed57580fcbf empty. 2023-07-18 04:10:32,193 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportWithTargetName/e227915d876324ca12228bbb45002eb3 empty. 2023-07-18 04:10:32,194 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportWithTargetName/43d0301e9465c8dda9208ed57580fcbf 2023-07-18 04:10:32,195 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportWithTargetName/e227915d876324ca12228bbb45002eb3 2023-07-18 04:10:32,195 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-18 04:10:32,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-18 04:10:32,276 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-18 04:10:32,279 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 43d0301e9465c8dda9208ed57580fcbf, NAME => 'testtb-testExportWithTargetName,,1689653432154.43d0301e9465c8dda9208ed57580fcbf.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp 2023-07-18 04:10:32,279 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => e227915d876324ca12228bbb45002eb3, NAME => 'testtb-testExportWithTargetName,1,1689653432154.e227915d876324ca12228bbb45002eb3.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp 2023-07-18 04:10:32,333 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689653432154.43d0301e9465c8dda9208ed57580fcbf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:10:32,335 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689653432154.e227915d876324ca12228bbb45002eb3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:10:32,335 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 43d0301e9465c8dda9208ed57580fcbf, disabling compactions & flushes 2023-07-18 04:10:32,338 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing e227915d876324ca12228bbb45002eb3, disabling compactions & flushes 2023-07-18 04:10:32,338 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689653432154.43d0301e9465c8dda9208ed57580fcbf. 2023-07-18 04:10:32,338 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689653432154.e227915d876324ca12228bbb45002eb3. 2023-07-18 04:10:32,338 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689653432154.43d0301e9465c8dda9208ed57580fcbf. 2023-07-18 04:10:32,338 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689653432154.e227915d876324ca12228bbb45002eb3. 2023-07-18 04:10:32,338 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689653432154.43d0301e9465c8dda9208ed57580fcbf. after waiting 0 ms 2023-07-18 04:10:32,338 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689653432154.e227915d876324ca12228bbb45002eb3. after waiting 0 ms 2023-07-18 04:10:32,338 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689653432154.43d0301e9465c8dda9208ed57580fcbf. 2023-07-18 04:10:32,338 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689653432154.e227915d876324ca12228bbb45002eb3. 2023-07-18 04:10:32,339 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689653432154.43d0301e9465c8dda9208ed57580fcbf. 2023-07-18 04:10:32,339 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689653432154.e227915d876324ca12228bbb45002eb3. 2023-07-18 04:10:32,339 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 43d0301e9465c8dda9208ed57580fcbf: 2023-07-18 04:10:32,339 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for e227915d876324ca12228bbb45002eb3: 2023-07-18 04:10:32,343 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 04:10:32,344 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689653432154.43d0301e9465c8dda9208ed57580fcbf.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689653432344"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653432344"}]},"ts":"1689653432344"} 2023-07-18 04:10:32,345 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689653432154.e227915d876324ca12228bbb45002eb3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689653432344"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653432344"}]},"ts":"1689653432344"} 2023-07-18 04:10:32,407 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 04:10:32,409 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 04:10:32,409 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653432409"}]},"ts":"1689653432409"} 2023-07-18 04:10:32,412 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-18 04:10:32,418 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 04:10:32,420 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 04:10:32,420 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 04:10:32,420 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 04:10:32,420 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 04:10:32,421 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=43d0301e9465c8dda9208ed57580fcbf, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e227915d876324ca12228bbb45002eb3, ASSIGN}] 2023-07-18 04:10:32,425 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e227915d876324ca12228bbb45002eb3, ASSIGN 2023-07-18 04:10:32,426 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=43d0301e9465c8dda9208ed57580fcbf, ASSIGN 2023-07-18 04:10:32,427 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e227915d876324ca12228bbb45002eb3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35525,1689653423141; forceNewPlan=false, retain=false 2023-07-18 04:10:32,427 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=43d0301e9465c8dda9208ed57580fcbf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43385,1689653423267; forceNewPlan=false, retain=false 2023-07-18 04:10:32,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-18 04:10:32,577 INFO [jenkins-hbase4:46231] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 04:10:32,580 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=e227915d876324ca12228bbb45002eb3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:32,580 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=43d0301e9465c8dda9208ed57580fcbf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:32,580 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689653432154.e227915d876324ca12228bbb45002eb3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689653432580"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653432580"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653432580"}]},"ts":"1689653432580"} 2023-07-18 04:10:32,580 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689653432154.43d0301e9465c8dda9208ed57580fcbf.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689653432580"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653432580"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653432580"}]},"ts":"1689653432580"} 2023-07-18 04:10:32,583 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 43d0301e9465c8dda9208ed57580fcbf, server=jenkins-hbase4.apache.org,43385,1689653423267}] 2023-07-18 04:10:32,585 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure e227915d876324ca12228bbb45002eb3, server=jenkins-hbase4.apache.org,35525,1689653423141}] 2023-07-18 04:10:32,744 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689653432154.43d0301e9465c8dda9208ed57580fcbf. 2023-07-18 04:10:32,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 43d0301e9465c8dda9208ed57580fcbf, NAME => 'testtb-testExportWithTargetName,,1689653432154.43d0301e9465c8dda9208ed57580fcbf.', STARTKEY => '', ENDKEY => '1'} 2023-07-18 04:10:32,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689653432154.43d0301e9465c8dda9208ed57580fcbf. service=AccessControlService 2023-07-18 04:10:32,745 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:10:32,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 43d0301e9465c8dda9208ed57580fcbf 2023-07-18 04:10:32,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689653432154.43d0301e9465c8dda9208ed57580fcbf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:10:32,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 43d0301e9465c8dda9208ed57580fcbf 2023-07-18 04:10:32,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 43d0301e9465c8dda9208ed57580fcbf 2023-07-18 04:10:32,749 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689653432154.e227915d876324ca12228bbb45002eb3. 2023-07-18 04:10:32,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e227915d876324ca12228bbb45002eb3, NAME => 'testtb-testExportWithTargetName,1,1689653432154.e227915d876324ca12228bbb45002eb3.', STARTKEY => '1', ENDKEY => ''} 2023-07-18 04:10:32,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689653432154.e227915d876324ca12228bbb45002eb3. service=AccessControlService 2023-07-18 04:10:32,749 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:10:32,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName e227915d876324ca12228bbb45002eb3 2023-07-18 04:10:32,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689653432154.e227915d876324ca12228bbb45002eb3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:10:32,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e227915d876324ca12228bbb45002eb3 2023-07-18 04:10:32,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e227915d876324ca12228bbb45002eb3 2023-07-18 04:10:32,750 INFO [StoreOpener-43d0301e9465c8dda9208ed57580fcbf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 43d0301e9465c8dda9208ed57580fcbf 2023-07-18 04:10:32,752 INFO [StoreOpener-e227915d876324ca12228bbb45002eb3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e227915d876324ca12228bbb45002eb3 2023-07-18 04:10:32,752 DEBUG [StoreOpener-43d0301e9465c8dda9208ed57580fcbf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportWithTargetName/43d0301e9465c8dda9208ed57580fcbf/cf 2023-07-18 04:10:32,753 DEBUG [StoreOpener-43d0301e9465c8dda9208ed57580fcbf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportWithTargetName/43d0301e9465c8dda9208ed57580fcbf/cf 2023-07-18 04:10:32,754 DEBUG [StoreOpener-e227915d876324ca12228bbb45002eb3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportWithTargetName/e227915d876324ca12228bbb45002eb3/cf 2023-07-18 04:10:32,754 DEBUG [StoreOpener-e227915d876324ca12228bbb45002eb3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportWithTargetName/e227915d876324ca12228bbb45002eb3/cf 2023-07-18 04:10:32,757 INFO [StoreOpener-e227915d876324ca12228bbb45002eb3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e227915d876324ca12228bbb45002eb3 columnFamilyName cf 2023-07-18 04:10:32,757 INFO [StoreOpener-43d0301e9465c8dda9208ed57580fcbf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 43d0301e9465c8dda9208ed57580fcbf columnFamilyName cf 2023-07-18 04:10:32,760 INFO [StoreOpener-e227915d876324ca12228bbb45002eb3-1] regionserver.HStore(310): Store=e227915d876324ca12228bbb45002eb3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:10:32,760 INFO [StoreOpener-43d0301e9465c8dda9208ed57580fcbf-1] regionserver.HStore(310): Store=43d0301e9465c8dda9208ed57580fcbf/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:10:32,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportWithTargetName/43d0301e9465c8dda9208ed57580fcbf 2023-07-18 04:10:32,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportWithTargetName/43d0301e9465c8dda9208ed57580fcbf 2023-07-18 04:10:32,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportWithTargetName/e227915d876324ca12228bbb45002eb3 2023-07-18 04:10:32,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportWithTargetName/e227915d876324ca12228bbb45002eb3 2023-07-18 04:10:32,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 43d0301e9465c8dda9208ed57580fcbf 2023-07-18 04:10:32,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-18 04:10:32,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportWithTargetName/43d0301e9465c8dda9208ed57580fcbf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 04:10:32,786 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 43d0301e9465c8dda9208ed57580fcbf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62411595, jitterRate=-0.06999476253986359}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 04:10:32,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 43d0301e9465c8dda9208ed57580fcbf: 2023-07-18 04:10:32,791 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689653432154.43d0301e9465c8dda9208ed57580fcbf., pid=15, masterSystemTime=1689653432736 2023-07-18 04:10:32,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e227915d876324ca12228bbb45002eb3 2023-07-18 04:10:32,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689653432154.43d0301e9465c8dda9208ed57580fcbf. 2023-07-18 04:10:32,798 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689653432154.43d0301e9465c8dda9208ed57580fcbf. 2023-07-18 04:10:32,800 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=43d0301e9465c8dda9208ed57580fcbf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:32,800 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689653432154.43d0301e9465c8dda9208ed57580fcbf.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689653432800"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689653432800"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689653432800"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689653432800"}]},"ts":"1689653432800"} 2023-07-18 04:10:32,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportWithTargetName/e227915d876324ca12228bbb45002eb3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 04:10:32,810 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-18 04:10:32,811 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 43d0301e9465c8dda9208ed57580fcbf, server=jenkins-hbase4.apache.org,43385,1689653423267 in 221 msec 2023-07-18 04:10:32,812 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e227915d876324ca12228bbb45002eb3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66839486, jitterRate=-0.004014045000076294}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 04:10:32,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e227915d876324ca12228bbb45002eb3: 2023-07-18 04:10:32,814 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689653432154.e227915d876324ca12228bbb45002eb3., pid=16, masterSystemTime=1689653432738 2023-07-18 04:10:32,814 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=43d0301e9465c8dda9208ed57580fcbf, ASSIGN in 389 msec 2023-07-18 04:10:32,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689653432154.e227915d876324ca12228bbb45002eb3. 2023-07-18 04:10:32,816 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689653432154.e227915d876324ca12228bbb45002eb3. 2023-07-18 04:10:32,817 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=e227915d876324ca12228bbb45002eb3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:32,818 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689653432154.e227915d876324ca12228bbb45002eb3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689653432817"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689653432817"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689653432817"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689653432817"}]},"ts":"1689653432817"} 2023-07-18 04:10:32,828 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-18 04:10:32,829 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure e227915d876324ca12228bbb45002eb3, server=jenkins-hbase4.apache.org,35525,1689653423141 in 236 msec 2023-07-18 04:10:32,832 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=12 2023-07-18 04:10:32,836 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e227915d876324ca12228bbb45002eb3, ASSIGN in 408 msec 2023-07-18 04:10:32,840 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 04:10:32,841 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653432841"}]},"ts":"1689653432841"} 2023-07-18 04:10:32,844 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-18 04:10:32,852 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 04:10:32,859 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-18 04:10:32,871 DEBUG [PEWorker-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:10:32,880 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37360, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:10:32,886 DEBUG [hconnection-0x53d2c2f5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:10:32,891 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55032, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2023-07-18 04:10:32,902 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35525] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-18 04:10:32,946 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-18 04:10:32,946 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 04:10:32,946 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-18 04:10:32,947 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-18 04:10:32,947 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-18 04:10:32,970 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 04:10:32,970 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-18 04:10:32,970 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 04:10:32,970 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-18 04:10:32,972 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-18 04:10:32,972 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-18 04:10:32,974 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 815 msec 2023-07-18 04:10:33,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-18 04:10:33,283 INFO [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-18 04:10:33,287 DEBUG [Listener at jenkins-hbase4.apache.org/40435] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-18 04:10:33,289 DEBUG [Listener at jenkins-hbase4.apache.org/40435] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689653432154.43d0301e9465c8dda9208ed57580fcbf. 2023-07-18 04:10:33,291 INFO [Listener at jenkins-hbase4.apache.org/40435] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 04:10:33,323 DEBUG [hconnection-0x1ab66b66-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:10:33,327 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37376, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:10:33,343 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-18 04:10:33,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689653433343 (current time:1689653433343). 2023-07-18 04:10:33,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 04:10:33,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(139): Connect 0x038bc559 to 127.0.0.1:64260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:10:33,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d18872f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:10:33,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:10:33,357 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55042, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:10:33,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x038bc559 to 127.0.0.1:64260 2023-07-18 04:10:33,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:10:33,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(139): Connect 0x19975002 to 127.0.0.1:64260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:10:33,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a6a0938, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:10:33,388 DEBUG [hconnection-0x564f5a9b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:10:33,390 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55048, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:10:33,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:10:33,399 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37390, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:10:33,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x19975002 to 127.0.0.1:64260 2023-07-18 04:10:33,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:10:33,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-18 04:10:33,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 04:10:33,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-18 04:10:33,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-18 04:10:33,457 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-18 04:10:33,459 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689654033458 2023-07-18 04:10:33,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-18 04:10:33,460 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-18 04:10:33,464 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-18 04:10:33,471 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 04:10:33,471 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 04:10:33,475 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-18 04:10:33,475 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 18 msec 2023-07-18 04:10:33,477 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-18 04:10:33,478 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689654033478 2023-07-18 04:10:33,504 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,505 INFO [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-18 04:10:33,505 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:10:33,506 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-18 04:10:33,506 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-18 04:10:33,507 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,507 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,513 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:33,513 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:33,513 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:33,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:33,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:33,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:33,513 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:33,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:33,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:33,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:33,513 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:33,514 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:33,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,514 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:33,514 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 04:10:33,514 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,514 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,514 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-18 04:10:33,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,516 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-18 04:10:33,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-18 04:10:33,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-18 04:10:33,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,517 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-18 04:10:33,517 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-18 04:10:33,519 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,519 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,519 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,519 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-18 04:10:33,520 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:10:33,520 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-18 04:10:33,521 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-18 04:10:33,521 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:10:33,521 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:10:33,521 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-18 04:10:33,522 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-18 04:10:33,523 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-18 04:10:33,523 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35525,1689653423141' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-18 04:10:33,522 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-18 04:10:33,523 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42889,1689653423206' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-18 04:10:33,524 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-18 04:10:33,524 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-18 04:10:33,524 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43385,1689653423267' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-18 04:10:33,526 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:33,526 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:33,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:10:33,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:10:33,527 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,528 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:33,528 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:10:33,528 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,528 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:10:33,528 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,528 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:10:33,528 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,529 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:10:33,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:10:33,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:33,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:33,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:33,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:10:33,534 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35525,1689653423141' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-18 04:10:33,534 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26910256[Count = 1] remaining members to acquire global barrier 2023-07-18 04:10:33,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:33,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:10:33,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:10:33,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:10:33,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:10:33,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:33,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:33,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:33,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:10:33,538 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43385,1689653423267' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-18 04:10:33,538 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26910256[Count = 0] remaining members to acquire global barrier 2023-07-18 04:10:33,538 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-18 04:10:33,538 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,541 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,541 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,541 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,542 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-18 04:10:33,542 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-18 04:10:33,542 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-18 04:10:33,542 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42889,1689653423206' in zk 2023-07-18 04:10:33,546 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-18 04:10:33,546 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689653432154.e227915d876324ca12228bbb45002eb3. 2023-07-18 04:10:33,546 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-18 04:10:33,546 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:10:33,546 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:10:33,546 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689653432154.e227915d876324ca12228bbb45002eb3. started... 2023-07-18 04:10:33,546 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:10:33,547 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:10:33,547 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689653432154.43d0301e9465c8dda9208ed57580fcbf. 2023-07-18 04:10:33,546 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:10:33,547 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689653432154.43d0301e9465c8dda9208ed57580fcbf. started... 2023-07-18 04:10:33,547 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:33,547 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-18 04:10:33,551 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:33,551 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 04:10:33,551 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e227915d876324ca12228bbb45002eb3: 2023-07-18 04:10:33,551 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 43d0301e9465c8dda9208ed57580fcbf: 2023-07-18 04:10:33,552 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689653432154.e227915d876324ca12228bbb45002eb3.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,552 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689653432154.43d0301e9465c8dda9208ed57580fcbf.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,558 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:10:33,558 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:10:33,561 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 04:10:33,561 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 04:10:33,571 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:10:33,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 04:10:33,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:10:33,577 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 04:10:33,604 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689653432154.e227915d876324ca12228bbb45002eb3. completed. 2023-07-18 04:10:33,605 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689653432154.e227915d876324ca12228bbb45002eb3. 2023-07-18 04:10:33,605 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:10:33,605 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:10:33,605 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:33,605 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-18 04:10:33,606 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35525,1689653423141' in zk 2023-07-18 04:10:33,606 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689653432154.43d0301e9465c8dda9208ed57580fcbf. completed. 2023-07-18 04:10:33,606 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689653432154.43d0301e9465c8dda9208ed57580fcbf. 2023-07-18 04:10:33,606 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:10:33,607 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:10:33,607 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:33,607 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-18 04:10:33,607 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43385,1689653423267' in zk 2023-07-18 04:10:33,608 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:33,608 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-18 04:10:33,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:33,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:10:33,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:10:33,608 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:10:33,608 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-18 04:10:33,611 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:33,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:10:33,611 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-18 04:10:33,611 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:10:33,611 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-18 04:10:33,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:10:33,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:33,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:33,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:33,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:10:33,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:33,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:33,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:33,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,35525,1689653423141': 2023-07-18 04:10:33,618 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35525,1689653423141' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-18 04:10:33,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:33,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:10:33,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:10:33,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:10:33,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:10:33,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:33,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:33,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:33,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:10:33,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:33,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:33,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:33,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43385,1689653423267': 2023-07-18 04:10:33,625 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43385,1689653423267' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-18 04:10:33,625 INFO [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-18 04:10:33,625 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 04:10:33,625 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 04:10:33,625 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,625 INFO [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 04:10:33,631 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,631 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,631 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:33,631 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:33,631 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,631 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:10:33,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:10:33,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,631 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:33,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:10:33,632 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:33,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:33,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:33,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:33,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:33,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:33,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:33,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,633 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:33,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:10:33,633 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:33,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:33,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:33,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:33,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:10:33,635 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:33,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,636 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:33,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:33,636 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:33,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:33,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:33,649 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:33,649 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:33,649 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:33,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:33,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:33,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:33,649 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:33,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:33,649 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:33,649 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:33,649 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:33,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:33,649 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:33,649 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:33,649 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,649 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:10:33,650 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-18 04:10:33,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:33,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:33,650 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,650 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:33,651 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-18 04:10:33,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:33,651 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:33,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:33,651 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:33,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:33,651 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,651 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:33,651 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:33,651 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,651 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,652 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-18 04:10:33,671 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,674 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,730 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,768 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-18 04:10:33,768 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,769 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:33,769 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689653433460Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689653433671 (+211 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689653433671Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689653433671Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689653433691 (+20 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689653433718 (+27 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689653433768 (+50 ms) 2023-07-18 04:10:33,771 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-18 04:10:33,773 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 306 msec 2023-07-18 04:10:33,777 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:10:33,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 04:10:33,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 04:10:33,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43385] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689653432154.43d0301e9465c8dda9208ed57580fcbf. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 04:10:33,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35525] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689653432154.e227915d876324ca12228bbb45002eb3. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 04:10:33,806 DEBUG [Listener at jenkins-hbase4.apache.org/40435] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-18 04:10:33,806 DEBUG [Listener at jenkins-hbase4.apache.org/40435] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689653432154.43d0301e9465c8dda9208ed57580fcbf. 2023-07-18 04:10:33,806 INFO [Listener at jenkins-hbase4.apache.org/40435] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 04:10:33,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-18 04:10:33,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689653433825 (current time:1689653433825). 2023-07-18 04:10:33,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 04:10:33,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(139): Connect 0x52ef62b3 to 127.0.0.1:64260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:10:33,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3629a6fb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:10:33,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:10:33,839 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55052, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:10:33,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x52ef62b3 to 127.0.0.1:64260 2023-07-18 04:10:33,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:10:33,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(139): Connect 0x6a5b9e2f to 127.0.0.1:64260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:10:33,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4308832d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:10:33,852 DEBUG [hconnection-0x386debc9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:10:33,855 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55066, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:10:33,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:10:33,861 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37392, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:10:33,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a5b9e2f to 127.0.0.1:64260 2023-07-18 04:10:33,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:10:33,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-18 04:10:33,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 04:10:33,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-18 04:10:33,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-18 04:10:33,868 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-18 04:10:33,869 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689654033869 2023-07-18 04:10:33,869 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-18 04:10:33,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-18 04:10:33,870 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 04:10:33,870 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 04:10:33,870 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-18 04:10:33,871 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-18 04:10:33,873 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-07-18 04:10:33,873 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-18 04:10:33,874 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689654033874 2023-07-18 04:10:33,891 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-18 04:10:33,891 INFO [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-18 04:10:33,891 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:10:33,892 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-18 04:10:33,892 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-18 04:10:33,892 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 04:10:33,893 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 04:10:33,894 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:33,894 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:33,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:33,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:33,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:33,894 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:33,894 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:33,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:33,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:33,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:33,895 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:33,895 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:33,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 04:10:33,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 04:10:33,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 04:10:33,895 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:33,895 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 04:10:33,895 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 04:10:33,895 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 04:10:33,895 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 04:10:33,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-18 04:10:33,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 04:10:33,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-18 04:10:33,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 04:10:33,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-18 04:10:33,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 04:10:33,896 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-18 04:10:33,896 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-18 04:10:33,896 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-18 04:10:33,896 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-18 04:10:33,896 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-18 04:10:33,896 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-18 04:10:33,896 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-18 04:10:33,896 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:10:33,896 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-18 04:10:33,897 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-18 04:10:33,897 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-18 04:10:33,897 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:10:33,896 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:10:33,898 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-18 04:10:33,899 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-18 04:10:33,899 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-18 04:10:33,897 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-18 04:10:33,899 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43385,1689653423267' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-18 04:10:33,899 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-18 04:10:33,899 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42889,1689653423206' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-18 04:10:33,899 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35525,1689653423141' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-18 04:10:33,901 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:33,901 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 04:10:33,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:33,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:10:33,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:10:33,907 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:33,907 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 04:10:33,908 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 04:10:33,908 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:10:33,908 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 04:10:33,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:10:33,908 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 04:10:33,908 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:10:33,908 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 04:10:33,908 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:10:33,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:10:33,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 04:10:33,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:33,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:33,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:33,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:10:33,910 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43385,1689653423267' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-18 04:10:33,910 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6054c8c5[Count = 1] remaining members to acquire global barrier 2023-07-18 04:10:33,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:33,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:10:33,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:10:33,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:10:33,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:10:33,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 04:10:33,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:33,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:33,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:33,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:10:33,913 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35525,1689653423141' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-18 04:10:33,913 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6054c8c5[Count = 0] remaining members to acquire global barrier 2023-07-18 04:10:33,913 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-18 04:10:33,913 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 04:10:33,919 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 04:10:33,919 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 04:10:33,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 04:10:33,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 04:10:33,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 04:10:33,919 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 04:10:33,919 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-18 04:10:33,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 04:10:33,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 04:10:33,919 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:33,920 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:10:33,920 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689653432154.43d0301e9465c8dda9208ed57580fcbf. 2023-07-18 04:10:33,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 04:10:33,920 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689653432154.43d0301e9465c8dda9208ed57580fcbf. started... 2023-07-18 04:10:33,920 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-18 04:10:33,920 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:10:33,920 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-18 04:10:33,920 INFO [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 43d0301e9465c8dda9208ed57580fcbf 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-18 04:10:33,920 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:10:33,920 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:10:33,920 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:33,920 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689653432154.e227915d876324ca12228bbb45002eb3. 2023-07-18 04:10:33,920 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-18 04:10:33,920 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689653432154.e227915d876324ca12228bbb45002eb3. started... 2023-07-18 04:10:33,920 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 04:10:33,920 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42889,1689653423206' in zk 2023-07-18 04:10:33,921 INFO [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e227915d876324ca12228bbb45002eb3 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-18 04:10:33,923 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-18 04:10:33,923 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:10:33,923 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-18 04:10:33,970 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:10:33,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 04:10:33,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:10:33,972 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 04:10:34,088 INFO [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071859bbc6a9019942d9bc432383062527b0 to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071859bbc6a9019942d9bc432383062527b0 2023-07-18 04:10:34,088 INFO [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307180dda23195c4546e6b2c35f7c09de17fe to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307180dda23195c4546e6b2c35f7c09de17fe 2023-07-18 04:10:34,122 INFO [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportWithTargetName/43d0301e9465c8dda9208ed57580fcbf/.tmp/cf/896f8d10ce384ee9b84b5ea1a0eeaee2 2023-07-18 04:10:34,130 INFO [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportWithTargetName/e227915d876324ca12228bbb45002eb3/.tmp/cf/ea455b20a1484cc69a202f1324723066 2023-07-18 04:10:34,140 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportWithTargetName/43d0301e9465c8dda9208ed57580fcbf/.tmp/cf/896f8d10ce384ee9b84b5ea1a0eeaee2 as hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportWithTargetName/43d0301e9465c8dda9208ed57580fcbf/cf/896f8d10ce384ee9b84b5ea1a0eeaee2 2023-07-18 04:10:34,141 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportWithTargetName/e227915d876324ca12228bbb45002eb3/.tmp/cf/ea455b20a1484cc69a202f1324723066 as hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportWithTargetName/e227915d876324ca12228bbb45002eb3/cf/ea455b20a1484cc69a202f1324723066 2023-07-18 04:10:34,149 INFO [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportWithTargetName/43d0301e9465c8dda9208ed57580fcbf/cf/896f8d10ce384ee9b84b5ea1a0eeaee2, entries=3, sequenceid=6, filesize=5.4 K 2023-07-18 04:10:34,156 INFO [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 43d0301e9465c8dda9208ed57580fcbf in 236ms, sequenceid=6, compaction requested=false 2023-07-18 04:10:34,156 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-18 04:10:34,157 INFO [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportWithTargetName/e227915d876324ca12228bbb45002eb3/cf/ea455b20a1484cc69a202f1324723066, entries=47, sequenceid=6, filesize=12.8 K 2023-07-18 04:10:34,159 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 43d0301e9465c8dda9208ed57580fcbf: 2023-07-18 04:10:34,159 INFO [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for e227915d876324ca12228bbb45002eb3 in 238ms, sequenceid=6, compaction requested=false 2023-07-18 04:10:34,160 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e227915d876324ca12228bbb45002eb3: 2023-07-18 04:10:34,160 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689653432154.43d0301e9465c8dda9208ed57580fcbf.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-18 04:10:34,160 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689653432154.e227915d876324ca12228bbb45002eb3.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-18 04:10:34,160 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:10:34,160 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:10:34,160 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportWithTargetName/e227915d876324ca12228bbb45002eb3/cf/ea455b20a1484cc69a202f1324723066] hfiles 2023-07-18 04:10:34,160 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportWithTargetName/43d0301e9465c8dda9208ed57580fcbf/cf/896f8d10ce384ee9b84b5ea1a0eeaee2] hfiles 2023-07-18 04:10:34,161 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportWithTargetName/e227915d876324ca12228bbb45002eb3/cf/ea455b20a1484cc69a202f1324723066 for snapshot=snaptb0-testExportWithTargetName 2023-07-18 04:10:34,161 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportWithTargetName/43d0301e9465c8dda9208ed57580fcbf/cf/896f8d10ce384ee9b84b5ea1a0eeaee2 for snapshot=snaptb0-testExportWithTargetName 2023-07-18 04:10:34,172 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:10:34,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 04:10:34,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:10:34,175 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 04:10:34,186 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689653432154.43d0301e9465c8dda9208ed57580fcbf. completed. 2023-07-18 04:10:34,186 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689653432154.43d0301e9465c8dda9208ed57580fcbf. 2023-07-18 04:10:34,187 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689653432154.e227915d876324ca12228bbb45002eb3. completed. 2023-07-18 04:10:34,187 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:10:34,187 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:10:34,187 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:34,187 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689653432154.e227915d876324ca12228bbb45002eb3. 2023-07-18 04:10:34,187 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-18 04:10:34,187 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:10:34,187 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:10:34,187 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:34,187 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43385,1689653423267' in zk 2023-07-18 04:10:34,187 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-18 04:10:34,187 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35525,1689653423141' in zk 2023-07-18 04:10:34,190 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:34,190 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:34,190 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-18 04:10:34,190 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-18 04:10:34,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:34,190 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:10:34,190 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:10:34,190 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-18 04:10:34,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:10:34,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:10:34,191 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-18 04:10:34,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:10:34,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:10:34,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 04:10:34,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:34,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:34,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:34,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:10:34,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 04:10:34,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:34,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:34,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:34,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43385,1689653423267': 2023-07-18 04:10:34,198 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43385,1689653423267' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-18 04:10:34,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:34,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:10:34,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:10:34,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:10:34,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:10:34,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 04:10:34,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:34,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:34,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:34,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:10:34,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 04:10:34,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:34,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:34,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:34,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,35525,1689653423141': 2023-07-18 04:10:34,203 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35525,1689653423141' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-18 04:10:34,203 INFO [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-18 04:10:34,203 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 04:10:34,203 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 04:10:34,204 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-18 04:10:34,204 INFO [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 04:10:34,206 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 04:10:34,206 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 04:10:34,206 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 04:10:34,206 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 04:10:34,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 04:10:34,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 04:10:34,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:10:34,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:10:34,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 04:10:34,206 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:34,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 04:10:34,206 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:34,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 04:10:34,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 04:10:34,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:34,206 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:34,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:34,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:10:34,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 04:10:34,207 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:34,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:34,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:34,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 04:10:34,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:34,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:34,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 04:10:34,208 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:34,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 04:10:34,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 04:10:34,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:10:34,208 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:34,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 04:10:34,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:34,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:34,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:34,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:10:34,211 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:34,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 04:10:34,211 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:34,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:34,212 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:34,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:34,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:34,222 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:34,222 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:34,222 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:34,222 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:34,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:34,222 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:34,222 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:34,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:34,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:34,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:34,222 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 04:10:34,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:34,222 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:34,222 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-18 04:10:34,222 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:10:34,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:34,222 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-18 04:10:34,222 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:34,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:34,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:34,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:34,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:34,223 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-18 04:10:34,223 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:34,224 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-18 04:10:34,224 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 04:10:34,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:34,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:34,224 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:34,224 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 04:10:34,224 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:34,224 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:34,224 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 04:10:34,224 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 04:10:34,225 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307180dda23195c4546e6b2c35f7c09de17fe, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071859bbc6a9019942d9bc432383062527b0] mob files 2023-07-18 04:10:34,226 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307180dda23195c4546e6b2c35f7c09de17fe 2023-07-18 04:10:34,226 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071859bbc6a9019942d9bc432383062527b0 2023-07-18 04:10:34,244 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-18 04:10:34,245 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-18 04:10:34,274 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-18 04:10:34,318 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-18 04:10:34,318 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-18 04:10:34,319 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-18 04:10:34,319 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689653433869Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689653434244 (+375 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689653434244Loading Region manifests for snaptb0-testExportWithTargetName at 1689653434244Writing data manifest for snaptb0-testExportWithTargetName at 1689653434249 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689653434263 (+14 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689653434318 (+55 ms) 2023-07-18 04:10:34,321 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-18 04:10:34,324 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 451 msec 2023-07-18 04:10:34,475 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:10:34,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 04:10:34,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 04:10:34,478 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653434478 2023-07-18 04:10:34,479 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43229, tgtDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653434478, rawTgtDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653434478, srcFsUri=hdfs://localhost:43229, srcDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8 2023-07-18 04:10:34,520 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43229, inputRoot=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8 2023-07-18 04:10:34,521 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1783189104_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653434478, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653434478/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-18 04:10:34,521 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43229, inputRoot=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8, snapshotDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-18 04:10:34,539 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653434478/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-18 04:10:34,695 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:34,695 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:34,696 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:34,696 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:34,697 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:34,697 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:34,697 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:34,805 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/hadoop-6653072717226995138.jar 2023-07-18 04:10:34,806 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:34,806 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:34,807 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:34,808 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:34,808 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:34,809 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:34,810 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 04:10:34,810 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 04:10:34,811 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 04:10:34,812 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 04:10:34,812 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 04:10:34,813 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 04:10:34,814 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 04:10:34,815 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 04:10:34,815 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 04:10:34,816 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 04:10:34,821 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:10:34,821 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:10:34,822 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 04:10:34,822 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:10:34,822 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:10:34,823 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 04:10:34,823 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 04:10:35,288 WARN [DataStreamer for file /user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/hadoop/mapreduce-am-staging-root-dir/jenkins/.staging/job_1689653430729_0001/libjars/hbase-metrics-2.4.18-SNAPSHOT.jar] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-18 04:10:35,783 WARN [Listener at jenkins-hbase4.apache.org/40435] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 04:10:35,789 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-18 04:10:35,800 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-18 04:10:36,216 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 04:10:36,217 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 04:10:36,839 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653430729_0001_000001 (auth:SIMPLE) 2023-07-18 04:10:38,258 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 04:10:42,073 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653430729_0001_000001 (auth:SIMPLE) 2023-07-18 04:10:44,405 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653430729_0001_000001 (auth:SIMPLE) 2023-07-18 04:10:47,283 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653430729_0001_000001 (auth:SIMPLE) 2023-07-18 04:10:48,631 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 04:10:48,635 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 04:10:48,653 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-18 04:10:48,653 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 04:10:48,654 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 04:10:48,654 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-559505343_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-18 04:10:48,655 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(367): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-18 04:10:48,655 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(367): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-18 04:10:48,655 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-559505343_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653434478/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653434478/.hbase-snapshot/testExportWithTargetName 2023-07-18 04:10:48,656 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(367): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653434478/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-18 04:10:48,656 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(367): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653434478/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-18 04:10:48,669 INFO [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-18 04:10:48,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-18 04:10:48,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-18 04:10:48,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-18 04:10:48,705 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653448705"}]},"ts":"1689653448705"} 2023-07-18 04:10:48,708 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-18 04:10:48,711 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-18 04:10:48,713 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=43d0301e9465c8dda9208ed57580fcbf, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e227915d876324ca12228bbb45002eb3, UNASSIGN}] 2023-07-18 04:10:48,716 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=43d0301e9465c8dda9208ed57580fcbf, UNASSIGN 2023-07-18 04:10:48,716 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e227915d876324ca12228bbb45002eb3, UNASSIGN 2023-07-18 04:10:48,717 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=e227915d876324ca12228bbb45002eb3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:48,717 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=43d0301e9465c8dda9208ed57580fcbf, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:48,717 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689653432154.e227915d876324ca12228bbb45002eb3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689653448717"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653448717"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653448717"}]},"ts":"1689653448717"} 2023-07-18 04:10:48,717 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689653432154.43d0301e9465c8dda9208ed57580fcbf.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689653448717"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653448717"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653448717"}]},"ts":"1689653448717"} 2023-07-18 04:10:48,720 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure e227915d876324ca12228bbb45002eb3, server=jenkins-hbase4.apache.org,35525,1689653423141}] 2023-07-18 04:10:48,721 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure 43d0301e9465c8dda9208ed57580fcbf, server=jenkins-hbase4.apache.org,43385,1689653423267}] 2023-07-18 04:10:48,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-18 04:10:48,883 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e227915d876324ca12228bbb45002eb3 2023-07-18 04:10:48,883 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 43d0301e9465c8dda9208ed57580fcbf 2023-07-18 04:10:48,883 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e227915d876324ca12228bbb45002eb3, disabling compactions & flushes 2023-07-18 04:10:48,883 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689653432154.e227915d876324ca12228bbb45002eb3. 2023-07-18 04:10:48,883 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 43d0301e9465c8dda9208ed57580fcbf, disabling compactions & flushes 2023-07-18 04:10:48,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689653432154.e227915d876324ca12228bbb45002eb3. 2023-07-18 04:10:48,884 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689653432154.43d0301e9465c8dda9208ed57580fcbf. 2023-07-18 04:10:48,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689653432154.e227915d876324ca12228bbb45002eb3. after waiting 0 ms 2023-07-18 04:10:48,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689653432154.e227915d876324ca12228bbb45002eb3. 2023-07-18 04:10:48,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689653432154.43d0301e9465c8dda9208ed57580fcbf. 2023-07-18 04:10:48,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689653432154.43d0301e9465c8dda9208ed57580fcbf. after waiting 0 ms 2023-07-18 04:10:48,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689653432154.43d0301e9465c8dda9208ed57580fcbf. 2023-07-18 04:10:48,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportWithTargetName/e227915d876324ca12228bbb45002eb3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 04:10:48,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportWithTargetName/43d0301e9465c8dda9208ed57580fcbf/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 04:10:48,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:10:48,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:10:48,914 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689653432154.43d0301e9465c8dda9208ed57580fcbf. 2023-07-18 04:10:48,914 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689653432154.e227915d876324ca12228bbb45002eb3. 2023-07-18 04:10:48,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 43d0301e9465c8dda9208ed57580fcbf: 2023-07-18 04:10:48,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e227915d876324ca12228bbb45002eb3: 2023-07-18 04:10:48,918 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 43d0301e9465c8dda9208ed57580fcbf 2023-07-18 04:10:48,919 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=43d0301e9465c8dda9208ed57580fcbf, regionState=CLOSED 2023-07-18 04:10:48,919 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689653432154.43d0301e9465c8dda9208ed57580fcbf.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689653448919"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653448919"}]},"ts":"1689653448919"} 2023-07-18 04:10:48,920 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e227915d876324ca12228bbb45002eb3 2023-07-18 04:10:48,921 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=e227915d876324ca12228bbb45002eb3, regionState=CLOSED 2023-07-18 04:10:48,921 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689653432154.e227915d876324ca12228bbb45002eb3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689653448921"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653448921"}]},"ts":"1689653448921"} 2023-07-18 04:10:48,927 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-18 04:10:48,927 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure 43d0301e9465c8dda9208ed57580fcbf, server=jenkins-hbase4.apache.org,43385,1689653423267 in 201 msec 2023-07-18 04:10:48,928 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-18 04:10:48,928 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure e227915d876324ca12228bbb45002eb3, server=jenkins-hbase4.apache.org,35525,1689653423141 in 204 msec 2023-07-18 04:10:48,931 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=43d0301e9465c8dda9208ed57580fcbf, UNASSIGN in 214 msec 2023-07-18 04:10:48,933 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-18 04:10:48,933 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e227915d876324ca12228bbb45002eb3, UNASSIGN in 215 msec 2023-07-18 04:10:48,934 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653448934"}]},"ts":"1689653448934"} 2023-07-18 04:10:48,936 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-18 04:10:48,938 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-18 04:10:48,943 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 263 msec 2023-07-18 04:10:49,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-18 04:10:49,001 INFO [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-18 04:10:49,008 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-18 04:10:49,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-18 04:10:49,021 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-18 04:10:49,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-18 04:10:49,024 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-18 04:10:49,027 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35525] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-18 04:10:49,031 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 04:10:49,031 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 04:10:49,031 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 04:10:49,031 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 04:10:49,032 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-18 04:10:49,032 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-18 04:10:49,032 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-18 04:10:49,033 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-18 04:10:49,033 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 04:10:49,033 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 04:10:49,033 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:10:49,034 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 04:10:49,034 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:10:49,033 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:10:49,033 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 04:10:49,035 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:10:49,036 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportWithTargetName/43d0301e9465c8dda9208ed57580fcbf 2023-07-18 04:10:49,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-18 04:10:49,043 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportWithTargetName/e227915d876324ca12228bbb45002eb3 2023-07-18 04:10:49,046 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportWithTargetName/43d0301e9465c8dda9208ed57580fcbf/cf, FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportWithTargetName/43d0301e9465c8dda9208ed57580fcbf/recovered.edits] 2023-07-18 04:10:49,046 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportWithTargetName/e227915d876324ca12228bbb45002eb3/cf, FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportWithTargetName/e227915d876324ca12228bbb45002eb3/recovered.edits] 2023-07-18 04:10:49,065 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportWithTargetName/43d0301e9465c8dda9208ed57580fcbf/cf/896f8d10ce384ee9b84b5ea1a0eeaee2 to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/archive/data/default/testtb-testExportWithTargetName/43d0301e9465c8dda9208ed57580fcbf/cf/896f8d10ce384ee9b84b5ea1a0eeaee2 2023-07-18 04:10:49,065 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportWithTargetName/e227915d876324ca12228bbb45002eb3/cf/ea455b20a1484cc69a202f1324723066 to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/archive/data/default/testtb-testExportWithTargetName/e227915d876324ca12228bbb45002eb3/cf/ea455b20a1484cc69a202f1324723066 2023-07-18 04:10:49,071 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportWithTargetName/43d0301e9465c8dda9208ed57580fcbf/recovered.edits/9.seqid to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/archive/data/default/testtb-testExportWithTargetName/43d0301e9465c8dda9208ed57580fcbf/recovered.edits/9.seqid 2023-07-18 04:10:49,073 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportWithTargetName/43d0301e9465c8dda9208ed57580fcbf 2023-07-18 04:10:49,073 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportWithTargetName/e227915d876324ca12228bbb45002eb3/recovered.edits/9.seqid to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/archive/data/default/testtb-testExportWithTargetName/e227915d876324ca12228bbb45002eb3/recovered.edits/9.seqid 2023-07-18 04:10:49,074 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportWithTargetName/e227915d876324ca12228bbb45002eb3 2023-07-18 04:10:49,074 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-18 04:10:49,075 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-18 04:10:49,077 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-18 04:10:49,084 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307180dda23195c4546e6b2c35f7c09de17fe to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307180dda23195c4546e6b2c35f7c09de17fe 2023-07-18 04:10:49,087 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071859bbc6a9019942d9bc432383062527b0 to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023071859bbc6a9019942d9bc432383062527b0 2023-07-18 04:10:49,088 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-18 04:10:49,091 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-18 04:10:49,119 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-18 04:10:49,123 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-18 04:10:49,125 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-18 04:10:49,125 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-18 04:10:49,125 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689653432154.43d0301e9465c8dda9208ed57580fcbf.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689653449125"}]},"ts":"9223372036854775807"} 2023-07-18 04:10:49,125 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689653432154.e227915d876324ca12228bbb45002eb3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689653449125"}]},"ts":"9223372036854775807"} 2023-07-18 04:10:49,131 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-18 04:10:49,131 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 43d0301e9465c8dda9208ed57580fcbf, NAME => 'testtb-testExportWithTargetName,,1689653432154.43d0301e9465c8dda9208ed57580fcbf.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e227915d876324ca12228bbb45002eb3, NAME => 'testtb-testExportWithTargetName,1,1689653432154.e227915d876324ca12228bbb45002eb3.', STARTKEY => '1', ENDKEY => ''}] 2023-07-18 04:10:49,131 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-18 04:10:49,132 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689653449131"}]},"ts":"9223372036854775807"} 2023-07-18 04:10:49,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-18 04:10:49,145 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-18 04:10:49,148 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-18 04:10:49,150 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 139 msec 2023-07-18 04:10:49,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-18 04:10:49,347 INFO [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-18 04:10:49,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-18 04:10:49,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-18 04:10:49,374 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-18 04:10:49,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-18 04:10:49,414 INFO [Listener at jenkins-hbase4.apache.org/40435] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=753 (was 707) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/cluster_5a53e081-17bb-4aef-d48c-01add87bea50/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-559505343_17 at /127.0.0.1:53332 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/cluster_5a53e081-17bb-4aef-d48c-01add87bea50/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/cluster_5a53e081-17bb-4aef-d48c-01add87bea50/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/cluster_5a53e081-17bb-4aef-d48c-01add87bea50/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/cluster_5a53e081-17bb-4aef-d48c-01add87bea50/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xf2856f0-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1313 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (1966361669) connection to jenkins-hbase4.apache.org/172.31.14.131:42011 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1966361669) connection to jenkins-hbase4.apache.org/172.31.14.131:36897 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xf2856f0-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xf2856f0-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xf2856f0-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/cluster_5a53e081-17bb-4aef-d48c-01add87bea50/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1427450207_1 at /127.0.0.1:59346 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1427450207_1 at /127.0.0.1:42630 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-559505343_17 at /127.0.0.1:42660 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=920 (was 905) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=249 (was 227) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 175) - ProcessCount LEAK? -, AvailableMemoryMB=3019 (was 4973) 2023-07-18 04:10:49,414 WARN [Listener at jenkins-hbase4.apache.org/40435] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-07-18 04:10:49,443 INFO [Listener at jenkins-hbase4.apache.org/40435] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=753, OpenFileDescriptor=920, MaxFileDescriptor=60000, SystemLoadAverage=249, ProcessCount=184, AvailableMemoryMB=3009 2023-07-18 04:10:49,443 WARN [Listener at jenkins-hbase4.apache.org/40435] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-07-18 04:10:49,464 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-18 04:10:49,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-18 04:10:49,471 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 04:10:49,472 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-18 04:10:49,473 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 04:10:49,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-18 04:10:49,478 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemState/67a6c7d4ffb4305cf120366efa7ce101 2023-07-18 04:10:49,479 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemState/0eab3326816fc0556519f61fcefc9437 2023-07-18 04:10:49,480 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemState/0eab3326816fc0556519f61fcefc9437 empty. 2023-07-18 04:10:49,480 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemState/0eab3326816fc0556519f61fcefc9437 2023-07-18 04:10:49,486 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemState/67a6c7d4ffb4305cf120366efa7ce101 empty. 2023-07-18 04:10:49,490 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemState/67a6c7d4ffb4305cf120366efa7ce101 2023-07-18 04:10:49,490 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-18 04:10:49,536 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-18 04:10:49,538 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 67a6c7d4ffb4305cf120366efa7ce101, NAME => 'testtb-testExportFileSystemState,,1689653449463.67a6c7d4ffb4305cf120366efa7ce101.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp 2023-07-18 04:10:49,539 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0eab3326816fc0556519f61fcefc9437, NAME => 'testtb-testExportFileSystemState,1,1689653449463.0eab3326816fc0556519f61fcefc9437.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp 2023-07-18 04:10:49,570 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689653449463.0eab3326816fc0556519f61fcefc9437.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:10:49,570 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 0eab3326816fc0556519f61fcefc9437, disabling compactions & flushes 2023-07-18 04:10:49,571 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689653449463.0eab3326816fc0556519f61fcefc9437. 2023-07-18 04:10:49,571 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689653449463.0eab3326816fc0556519f61fcefc9437. 2023-07-18 04:10:49,571 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689653449463.0eab3326816fc0556519f61fcefc9437. after waiting 0 ms 2023-07-18 04:10:49,571 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689653449463.0eab3326816fc0556519f61fcefc9437. 2023-07-18 04:10:49,571 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689653449463.0eab3326816fc0556519f61fcefc9437. 2023-07-18 04:10:49,571 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 0eab3326816fc0556519f61fcefc9437: 2023-07-18 04:10:49,581 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689653449463.67a6c7d4ffb4305cf120366efa7ce101.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:10:49,582 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 67a6c7d4ffb4305cf120366efa7ce101, disabling compactions & flushes 2023-07-18 04:10:49,582 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689653449463.67a6c7d4ffb4305cf120366efa7ce101. 2023-07-18 04:10:49,582 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689653449463.67a6c7d4ffb4305cf120366efa7ce101. 2023-07-18 04:10:49,583 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689653449463.67a6c7d4ffb4305cf120366efa7ce101. after waiting 0 ms 2023-07-18 04:10:49,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-18 04:10:49,583 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689653449463.67a6c7d4ffb4305cf120366efa7ce101. 2023-07-18 04:10:49,583 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689653449463.67a6c7d4ffb4305cf120366efa7ce101. 2023-07-18 04:10:49,583 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 67a6c7d4ffb4305cf120366efa7ce101: 2023-07-18 04:10:49,594 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 04:10:49,604 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689653449463.0eab3326816fc0556519f61fcefc9437.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689653449603"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653449603"}]},"ts":"1689653449603"} 2023-07-18 04:10:49,604 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689653449463.67a6c7d4ffb4305cf120366efa7ce101.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689653449603"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653449603"}]},"ts":"1689653449603"} 2023-07-18 04:10:49,626 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 04:10:49,627 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 04:10:49,628 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653449628"}]},"ts":"1689653449628"} 2023-07-18 04:10:49,630 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-18 04:10:49,639 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 04:10:49,640 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 04:10:49,641 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 04:10:49,641 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 04:10:49,641 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 04:10:49,641 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=67a6c7d4ffb4305cf120366efa7ce101, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0eab3326816fc0556519f61fcefc9437, ASSIGN}] 2023-07-18 04:10:49,644 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=67a6c7d4ffb4305cf120366efa7ce101, ASSIGN 2023-07-18 04:10:49,644 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0eab3326816fc0556519f61fcefc9437, ASSIGN 2023-07-18 04:10:49,646 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=67a6c7d4ffb4305cf120366efa7ce101, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35525,1689653423141; forceNewPlan=false, retain=false 2023-07-18 04:10:49,646 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0eab3326816fc0556519f61fcefc9437, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43385,1689653423267; forceNewPlan=false, retain=false 2023-07-18 04:10:49,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-18 04:10:49,796 INFO [jenkins-hbase4:46231] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 04:10:49,799 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=0eab3326816fc0556519f61fcefc9437, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:49,799 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=67a6c7d4ffb4305cf120366efa7ce101, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:49,799 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689653449463.0eab3326816fc0556519f61fcefc9437.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689653449799"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653449799"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653449799"}]},"ts":"1689653449799"} 2023-07-18 04:10:49,800 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689653449463.67a6c7d4ffb4305cf120366efa7ce101.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689653449799"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653449799"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653449799"}]},"ts":"1689653449799"} 2023-07-18 04:10:49,802 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 0eab3326816fc0556519f61fcefc9437, server=jenkins-hbase4.apache.org,43385,1689653423267}] 2023-07-18 04:10:49,803 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 67a6c7d4ffb4305cf120366efa7ce101, server=jenkins-hbase4.apache.org,35525,1689653423141}] 2023-07-18 04:10:49,959 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689653449463.0eab3326816fc0556519f61fcefc9437. 2023-07-18 04:10:49,959 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0eab3326816fc0556519f61fcefc9437, NAME => 'testtb-testExportFileSystemState,1,1689653449463.0eab3326816fc0556519f61fcefc9437.', STARTKEY => '1', ENDKEY => ''} 2023-07-18 04:10:49,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689653449463.0eab3326816fc0556519f61fcefc9437. service=AccessControlService 2023-07-18 04:10:49,960 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:10:49,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 0eab3326816fc0556519f61fcefc9437 2023-07-18 04:10:49,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689653449463.0eab3326816fc0556519f61fcefc9437.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:10:49,960 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689653449463.67a6c7d4ffb4305cf120366efa7ce101. 2023-07-18 04:10:49,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0eab3326816fc0556519f61fcefc9437 2023-07-18 04:10:49,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0eab3326816fc0556519f61fcefc9437 2023-07-18 04:10:49,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 67a6c7d4ffb4305cf120366efa7ce101, NAME => 'testtb-testExportFileSystemState,,1689653449463.67a6c7d4ffb4305cf120366efa7ce101.', STARTKEY => '', ENDKEY => '1'} 2023-07-18 04:10:49,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689653449463.67a6c7d4ffb4305cf120366efa7ce101. service=AccessControlService 2023-07-18 04:10:49,962 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:10:49,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 67a6c7d4ffb4305cf120366efa7ce101 2023-07-18 04:10:49,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689653449463.67a6c7d4ffb4305cf120366efa7ce101.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:10:49,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 67a6c7d4ffb4305cf120366efa7ce101 2023-07-18 04:10:49,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 67a6c7d4ffb4305cf120366efa7ce101 2023-07-18 04:10:49,962 INFO [StoreOpener-0eab3326816fc0556519f61fcefc9437-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0eab3326816fc0556519f61fcefc9437 2023-07-18 04:10:49,963 INFO [StoreOpener-67a6c7d4ffb4305cf120366efa7ce101-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 67a6c7d4ffb4305cf120366efa7ce101 2023-07-18 04:10:49,964 DEBUG [StoreOpener-0eab3326816fc0556519f61fcefc9437-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemState/0eab3326816fc0556519f61fcefc9437/cf 2023-07-18 04:10:49,964 DEBUG [StoreOpener-0eab3326816fc0556519f61fcefc9437-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemState/0eab3326816fc0556519f61fcefc9437/cf 2023-07-18 04:10:49,965 INFO [StoreOpener-0eab3326816fc0556519f61fcefc9437-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0eab3326816fc0556519f61fcefc9437 columnFamilyName cf 2023-07-18 04:10:49,965 DEBUG [StoreOpener-67a6c7d4ffb4305cf120366efa7ce101-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemState/67a6c7d4ffb4305cf120366efa7ce101/cf 2023-07-18 04:10:49,965 DEBUG [StoreOpener-67a6c7d4ffb4305cf120366efa7ce101-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemState/67a6c7d4ffb4305cf120366efa7ce101/cf 2023-07-18 04:10:49,965 INFO [StoreOpener-67a6c7d4ffb4305cf120366efa7ce101-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 67a6c7d4ffb4305cf120366efa7ce101 columnFamilyName cf 2023-07-18 04:10:49,967 INFO [StoreOpener-67a6c7d4ffb4305cf120366efa7ce101-1] regionserver.HStore(310): Store=67a6c7d4ffb4305cf120366efa7ce101/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:10:49,967 INFO [StoreOpener-0eab3326816fc0556519f61fcefc9437-1] regionserver.HStore(310): Store=0eab3326816fc0556519f61fcefc9437/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:10:49,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemState/67a6c7d4ffb4305cf120366efa7ce101 2023-07-18 04:10:49,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemState/67a6c7d4ffb4305cf120366efa7ce101 2023-07-18 04:10:49,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemState/0eab3326816fc0556519f61fcefc9437 2023-07-18 04:10:49,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemState/0eab3326816fc0556519f61fcefc9437 2023-07-18 04:10:49,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 67a6c7d4ffb4305cf120366efa7ce101 2023-07-18 04:10:49,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0eab3326816fc0556519f61fcefc9437 2023-07-18 04:10:49,982 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemState/0eab3326816fc0556519f61fcefc9437/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 04:10:49,982 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemState/67a6c7d4ffb4305cf120366efa7ce101/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 04:10:49,983 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 67a6c7d4ffb4305cf120366efa7ce101; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74340460, jitterRate=0.10775917768478394}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 04:10:49,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 67a6c7d4ffb4305cf120366efa7ce101: 2023-07-18 04:10:49,983 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0eab3326816fc0556519f61fcefc9437; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67398902, jitterRate=0.0043219029903411865}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 04:10:49,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0eab3326816fc0556519f61fcefc9437: 2023-07-18 04:10:49,985 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689653449463.0eab3326816fc0556519f61fcefc9437., pid=30, masterSystemTime=1689653449955 2023-07-18 04:10:49,985 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689653449463.67a6c7d4ffb4305cf120366efa7ce101., pid=31, masterSystemTime=1689653449957 2023-07-18 04:10:49,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689653449463.0eab3326816fc0556519f61fcefc9437. 2023-07-18 04:10:49,987 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689653449463.0eab3326816fc0556519f61fcefc9437. 2023-07-18 04:10:49,988 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=0eab3326816fc0556519f61fcefc9437, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:49,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689653449463.67a6c7d4ffb4305cf120366efa7ce101. 2023-07-18 04:10:49,988 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689653449463.67a6c7d4ffb4305cf120366efa7ce101. 2023-07-18 04:10:49,988 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689653449463.0eab3326816fc0556519f61fcefc9437.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689653449988"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689653449988"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689653449988"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689653449988"}]},"ts":"1689653449988"} 2023-07-18 04:10:49,989 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=67a6c7d4ffb4305cf120366efa7ce101, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:49,989 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689653449463.67a6c7d4ffb4305cf120366efa7ce101.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689653449989"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689653449989"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689653449989"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689653449989"}]},"ts":"1689653449989"} 2023-07-18 04:10:49,993 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-18 04:10:49,995 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 0eab3326816fc0556519f61fcefc9437, server=jenkins-hbase4.apache.org,43385,1689653423267 in 188 msec 2023-07-18 04:10:50,000 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-18 04:10:50,003 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 67a6c7d4ffb4305cf120366efa7ce101, server=jenkins-hbase4.apache.org,35525,1689653423141 in 189 msec 2023-07-18 04:10:50,004 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0eab3326816fc0556519f61fcefc9437, ASSIGN in 357 msec 2023-07-18 04:10:50,006 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-18 04:10:50,006 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=67a6c7d4ffb4305cf120366efa7ce101, ASSIGN in 359 msec 2023-07-18 04:10:50,008 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 04:10:50,008 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653450008"}]},"ts":"1689653450008"} 2023-07-18 04:10:50,019 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-18 04:10:50,023 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 04:10:50,023 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-18 04:10:50,027 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35525] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-18 04:10:50,031 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:10:50,031 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:10:50,031 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:10:50,031 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:10:50,033 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 04:10:50,033 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 04:10:50,033 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 04:10:50,033 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 04:10:50,038 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 567 msec 2023-07-18 04:10:50,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-18 04:10:50,087 INFO [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-18 04:10:50,090 DEBUG [Listener at jenkins-hbase4.apache.org/40435] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-18 04:10:50,090 DEBUG [Listener at jenkins-hbase4.apache.org/40435] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689653449463.67a6c7d4ffb4305cf120366efa7ce101. 2023-07-18 04:10:50,093 INFO [Listener at jenkins-hbase4.apache.org/40435] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 04:10:50,109 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 04:10:50,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689653450109 (current time:1689653450109). 2023-07-18 04:10:50,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 04:10:50,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(139): Connect 0x60b613ce to 127.0.0.1:64260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:10:50,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f5eaa1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:10:50,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:10:50,125 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56700, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:10:50,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60b613ce to 127.0.0.1:64260 2023-07-18 04:10:50,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:10:50,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(139): Connect 0x08d419b2 to 127.0.0.1:64260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:10:50,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@58ac4305, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:10:50,135 DEBUG [hconnection-0x77231a53-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:10:50,138 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56714, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:10:50,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:10:50,145 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59062, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:10:50,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x08d419b2 to 127.0.0.1:64260 2023-07-18 04:10:50,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:10:50,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-18 04:10:50,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 04:10:50,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 04:10:50,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-18 04:10:50,153 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-18 04:10:50,154 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689654050154 2023-07-18 04:10:50,154 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-18 04:10:50,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 04:10:50,156 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 04:10:50,156 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 04:10:50,156 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-18 04:10:50,158 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-18 04:10:50,160 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-07-18 04:10:50,162 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-18 04:10:50,163 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689654050163 2023-07-18 04:10:50,192 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,192 INFO [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-18 04:10:50,192 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:10:50,194 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-18 04:10:50,194 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-18 04:10:50,194 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,194 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,197 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:50,197 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:50,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:50,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:50,197 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:50,197 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:50,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:50,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:50,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:50,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:50,198 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:50,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,198 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:50,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,198 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:50,198 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 04:10:50,198 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,199 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,199 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-18 04:10:50,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,199 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-18 04:10:50,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-18 04:10:50,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-18 04:10:50,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,199 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,199 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-18 04:10:50,199 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-18 04:10:50,199 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:10:50,199 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-18 04:10:50,199 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,201 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-18 04:10:50,201 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-18 04:10:50,201 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:10:50,201 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-18 04:10:50,203 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-18 04:10:50,203 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-18 04:10:50,201 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,203 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35525,1689653423141' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-18 04:10:50,203 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-18 04:10:50,203 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42889,1689653423206' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-18 04:10:50,203 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:10:50,204 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-18 04:10:50,204 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-18 04:10:50,204 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43385,1689653423267' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-18 04:10:50,211 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,211 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,211 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:50,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:50,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:10:50,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:10:50,212 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:50,212 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,212 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,212 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,212 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:10:50,212 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:10:50,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:10:50,213 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,213 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:10:50,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:10:50,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:50,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:50,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:50,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:10:50,215 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35525,1689653423141' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-18 04:10:50,215 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@10d0a908[Count = 1] remaining members to acquire global barrier 2023-07-18 04:10:50,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:50,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:10:50,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:10:50,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:10:50,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:10:50,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:50,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:50,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:50,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:10:50,218 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43385,1689653423267' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-18 04:10:50,218 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@10d0a908[Count = 0] remaining members to acquire global barrier 2023-07-18 04:10:50,218 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-18 04:10:50,218 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,219 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,219 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,219 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-18 04:10:50,220 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,220 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-18 04:10:50,220 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-18 04:10:50,220 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-18 04:10:50,220 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42889,1689653423206' in zk 2023-07-18 04:10:50,221 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:50,222 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:10:50,223 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:10:50,223 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689653449463.0eab3326816fc0556519f61fcefc9437. 2023-07-18 04:10:50,223 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:10:50,223 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689653449463.67a6c7d4ffb4305cf120366efa7ce101. 2023-07-18 04:10:50,223 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689653449463.0eab3326816fc0556519f61fcefc9437. started... 2023-07-18 04:10:50,223 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689653449463.67a6c7d4ffb4305cf120366efa7ce101. started... 2023-07-18 04:10:50,223 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:10:50,225 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0eab3326816fc0556519f61fcefc9437: 2023-07-18 04:10:50,225 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 67a6c7d4ffb4305cf120366efa7ce101: 2023-07-18 04:10:50,225 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689653449463.0eab3326816fc0556519f61fcefc9437.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,225 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689653449463.67a6c7d4ffb4305cf120366efa7ce101.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,225 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:10:50,225 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:10:50,225 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 04:10:50,225 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 04:10:50,228 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:50,228 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 04:10:50,228 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-18 04:10:50,228 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:10:50,228 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-18 04:10:50,247 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689653449463.0eab3326816fc0556519f61fcefc9437. completed. 2023-07-18 04:10:50,247 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689653449463.0eab3326816fc0556519f61fcefc9437. 2023-07-18 04:10:50,248 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:10:50,248 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:10:50,248 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:50,248 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-18 04:10:50,248 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43385,1689653423267' in zk 2023-07-18 04:10:50,250 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-18 04:10:50,250 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:10:50,250 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:50,250 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-18 04:10:50,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:50,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:10:50,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:10:50,252 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689653449463.67a6c7d4ffb4305cf120366efa7ce101. completed. 2023-07-18 04:10:50,253 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689653449463.67a6c7d4ffb4305cf120366efa7ce101. 2023-07-18 04:10:50,253 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:10:50,253 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:10:50,253 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:50,253 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-18 04:10:50,253 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35525,1689653423141' in zk 2023-07-18 04:10:50,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:10:50,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:10:50,255 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:50,255 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-18 04:10:50,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,255 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:10:50,255 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-18 04:10:50,257 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:10:50,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:50,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:50,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 04:10:50,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:50,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:10:50,258 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 04:10:50,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:10:50,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:50,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:50,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:50,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43385,1689653423267': 2023-07-18 04:10:50,266 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43385,1689653423267' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-18 04:10:50,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:50,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:10:50,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:10:50,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:10:50,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:10:50,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:50,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:50,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:50,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:10:50,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:50,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:50,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:50,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,35525,1689653423141': 2023-07-18 04:10:50,271 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35525,1689653423141' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-18 04:10:50,271 INFO [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-18 04:10:50,271 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 04:10:50,271 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 04:10:50,271 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,271 INFO [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 04:10:50,273 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,273 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,273 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:10:50,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:10:50,273 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:50,273 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,273 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:50,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,273 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:50,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:10:50,274 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:50,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:50,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:50,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:50,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:50,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:50,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:50,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,274 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:50,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:10:50,275 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:50,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:50,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:50,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:50,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:10:50,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,277 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:50,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:50,277 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:50,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:50,278 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:50,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:50,282 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:50,282 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,282 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:50,282 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:50,282 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:50,282 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:50,282 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:10:50,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:50,282 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:50,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:50,284 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:50,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:50,282 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:50,284 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-18 04:10:50,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:50,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:50,284 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,282 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:50,284 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-18 04:10:50,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:50,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:50,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:50,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:50,282 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:50,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:50,285 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:50,285 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:50,285 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,285 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:50,285 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:50,285 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,285 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,285 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-18 04:10:50,307 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,308 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,349 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,375 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-18 04:10:50,376 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,376 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-18 04:10:50,376 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689653450154Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689653450307 (+153 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689653450307Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689653450308 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689653450316 (+8 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689653450339 (+23 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689653450375 (+36 ms) 2023-07-18 04:10:50,379 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-18 04:10:50,382 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 224 msec 2023-07-18 04:10:50,458 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:10:50,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 04:10:50,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 04:10:50,468 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35525] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689653449463.67a6c7d4ffb4305cf120366efa7ce101. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 04:10:50,470 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43385] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689653449463.0eab3326816fc0556519f61fcefc9437. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 04:10:50,474 DEBUG [Listener at jenkins-hbase4.apache.org/40435] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-18 04:10:50,474 DEBUG [Listener at jenkins-hbase4.apache.org/40435] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689653449463.67a6c7d4ffb4305cf120366efa7ce101. 2023-07-18 04:10:50,474 INFO [Listener at jenkins-hbase4.apache.org/40435] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 04:10:50,487 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 04:10:50,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689653450487 (current time:1689653450487). 2023-07-18 04:10:50,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 04:10:50,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(139): Connect 0x485778e4 to 127.0.0.1:64260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:10:50,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f0a065c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:10:50,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:10:50,500 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49482, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:10:50,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x485778e4 to 127.0.0.1:64260 2023-07-18 04:10:50,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:10:50,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(139): Connect 0x03ae8619 to 127.0.0.1:64260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:10:50,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6fea9e63, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:10:50,512 DEBUG [hconnection-0x315f1bd9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:10:50,513 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49488, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:10:50,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:10:50,520 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44730, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:10:50,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x03ae8619 to 127.0.0.1:64260 2023-07-18 04:10:50,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:10:50,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-18 04:10:50,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 04:10:50,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 04:10:50,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-18 04:10:50,525 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-18 04:10:50,526 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689654050526 2023-07-18 04:10:50,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 04:10:50,526 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-18 04:10:50,528 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 04:10:50,528 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 04:10:50,528 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-18 04:10:50,529 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-18 04:10:50,531 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-18 04:10:50,532 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-18 04:10:50,532 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689654050532 2023-07-18 04:10:50,547 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-18 04:10:50,547 INFO [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-18 04:10:50,547 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:10:50,549 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-18 04:10:50,549 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-18 04:10:50,549 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,549 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,551 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:50,551 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:50,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:50,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:50,551 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:50,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:50,551 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:50,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:50,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:50,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:50,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,552 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:50,552 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:50,552 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,552 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,552 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:50,552 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 04:10:50,552 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-18 04:10:50,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-18 04:10:50,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,553 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-18 04:10:50,553 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-18 04:10:50,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-18 04:10:50,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,553 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-18 04:10:50,553 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-18 04:10:50,554 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-18 04:10:50,554 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-18 04:10:50,554 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-18 04:10:50,554 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:10:50,554 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-18 04:10:50,554 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-18 04:10:50,555 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:10:50,555 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-18 04:10:50,555 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:10:50,556 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-18 04:10:50,556 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-18 04:10:50,557 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-18 04:10:50,557 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42889,1689653423206' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-18 04:10:50,557 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35525,1689653423141' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-18 04:10:50,557 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-18 04:10:50,557 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-18 04:10:50,557 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43385,1689653423267' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-18 04:10:50,559 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,559 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,559 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,560 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,560 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:10:50,560 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,560 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:10:50,560 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,560 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:10:50,561 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:50,562 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:50,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:50,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:10:50,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:10:50,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:10:50,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:10:50,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 04:10:50,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:50,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:50,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:50,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:10:50,564 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35525,1689653423141' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-18 04:10:50,564 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3efd8af6[Count = 1] remaining members to acquire global barrier 2023-07-18 04:10:50,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:50,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:10:50,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:10:50,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:10:50,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:10:50,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 04:10:50,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:50,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:50,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:50,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:10:50,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43385,1689653423267' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-18 04:10:50,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3efd8af6[Count = 0] remaining members to acquire global barrier 2023-07-18 04:10:50,567 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-18 04:10:50,567 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,570 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,570 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,570 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,570 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-18 04:10:50,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,571 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:50,571 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:10:50,571 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:10:50,571 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-18 04:10:50,571 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-18 04:10:50,571 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-18 04:10:50,571 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689653449463.67a6c7d4ffb4305cf120366efa7ce101. 2023-07-18 04:10:50,571 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:50,571 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 04:10:50,571 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42889,1689653423206' in zk 2023-07-18 04:10:50,571 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689653449463.0eab3326816fc0556519f61fcefc9437. 2023-07-18 04:10:50,572 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689653449463.0eab3326816fc0556519f61fcefc9437. started... 2023-07-18 04:10:50,571 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689653449463.67a6c7d4ffb4305cf120366efa7ce101. started... 2023-07-18 04:10:50,571 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:10:50,572 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:10:50,572 INFO [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 67a6c7d4ffb4305cf120366efa7ce101 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-18 04:10:50,572 INFO [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0eab3326816fc0556519f61fcefc9437 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-18 04:10:50,573 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-18 04:10:50,573 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:10:50,573 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-18 04:10:50,600 INFO [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307188e339e8f77fb4f72a29afab4227ee691 to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307188e339e8f77fb4f72a29afab4227ee691 2023-07-18 04:10:50,600 INFO [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230718d15a83ff9e3c48e0a345ab6227753965 to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230718d15a83ff9e3c48e0a345ab6227753965 2023-07-18 04:10:50,612 INFO [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemState/67a6c7d4ffb4305cf120366efa7ce101/.tmp/cf/dcfabbc640aa4d7e8aebda5b3713b529 2023-07-18 04:10:50,612 INFO [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemState/0eab3326816fc0556519f61fcefc9437/.tmp/cf/59c1c7d3b6bd43c4bb41d8e27245d7ab 2023-07-18 04:10:50,620 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemState/0eab3326816fc0556519f61fcefc9437/.tmp/cf/59c1c7d3b6bd43c4bb41d8e27245d7ab as hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemState/0eab3326816fc0556519f61fcefc9437/cf/59c1c7d3b6bd43c4bb41d8e27245d7ab 2023-07-18 04:10:50,622 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemState/67a6c7d4ffb4305cf120366efa7ce101/.tmp/cf/dcfabbc640aa4d7e8aebda5b3713b529 as hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemState/67a6c7d4ffb4305cf120366efa7ce101/cf/dcfabbc640aa4d7e8aebda5b3713b529 2023-07-18 04:10:50,627 INFO [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemState/0eab3326816fc0556519f61fcefc9437/cf/59c1c7d3b6bd43c4bb41d8e27245d7ab, entries=46, sequenceid=6, filesize=12.7 K 2023-07-18 04:10:50,628 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:10:50,628 INFO [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 0eab3326816fc0556519f61fcefc9437 in 56ms, sequenceid=6, compaction requested=false 2023-07-18 04:10:50,628 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-18 04:10:50,629 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0eab3326816fc0556519f61fcefc9437: 2023-07-18 04:10:50,629 INFO [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemState/67a6c7d4ffb4305cf120366efa7ce101/cf/dcfabbc640aa4d7e8aebda5b3713b529, entries=4, sequenceid=6, filesize=5.6 K 2023-07-18 04:10:50,629 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689653449463.0eab3326816fc0556519f61fcefc9437.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-18 04:10:50,629 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:10:50,629 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemState/0eab3326816fc0556519f61fcefc9437/cf/59c1c7d3b6bd43c4bb41d8e27245d7ab] hfiles 2023-07-18 04:10:50,629 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemState/0eab3326816fc0556519f61fcefc9437/cf/59c1c7d3b6bd43c4bb41d8e27245d7ab for snapshot=snaptb0-testExportFileSystemState 2023-07-18 04:10:50,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 04:10:50,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:10:50,630 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 04:10:50,631 INFO [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 67a6c7d4ffb4305cf120366efa7ce101 in 59ms, sequenceid=6, compaction requested=false 2023-07-18 04:10:50,633 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 67a6c7d4ffb4305cf120366efa7ce101: 2023-07-18 04:10:50,633 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689653449463.67a6c7d4ffb4305cf120366efa7ce101.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-18 04:10:50,633 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:10:50,633 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemState/67a6c7d4ffb4305cf120366efa7ce101/cf/dcfabbc640aa4d7e8aebda5b3713b529] hfiles 2023-07-18 04:10:50,633 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemState/67a6c7d4ffb4305cf120366efa7ce101/cf/dcfabbc640aa4d7e8aebda5b3713b529 for snapshot=snaptb0-testExportFileSystemState 2023-07-18 04:10:50,644 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689653449463.67a6c7d4ffb4305cf120366efa7ce101. completed. 2023-07-18 04:10:50,644 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689653449463.67a6c7d4ffb4305cf120366efa7ce101. 2023-07-18 04:10:50,644 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:10:50,644 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:10:50,644 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:50,644 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-18 04:10:50,644 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35525,1689653423141' in zk 2023-07-18 04:10:50,649 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689653449463.0eab3326816fc0556519f61fcefc9437. completed. 2023-07-18 04:10:50,649 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689653449463.0eab3326816fc0556519f61fcefc9437. 2023-07-18 04:10:50,649 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:10:50,649 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:10:50,649 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:50,649 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-18 04:10:50,649 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43385,1689653423267' in zk 2023-07-18 04:10:50,650 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:50,650 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-18 04:10:50,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:50,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:10:50,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:10:50,650 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:10:50,650 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-18 04:10:50,652 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-18 04:10:50,652 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:50,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:10:50,652 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:10:50,652 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-18 04:10:50,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:10:50,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 04:10:50,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:50,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:50,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:50,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:10:50,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 04:10:50,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:50,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:50,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:50,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,35525,1689653423141': 2023-07-18 04:10:50,665 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35525,1689653423141' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-18 04:10:50,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:50,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:10:50,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:10:50,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:10:50,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:10:50,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 04:10:50,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:50,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:50,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:50,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:10:50,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 04:10:50,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:50,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:50,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:50,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43385,1689653423267': 2023-07-18 04:10:50,674 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43385,1689653423267' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-18 04:10:50,674 INFO [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-18 04:10:50,674 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 04:10:50,674 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 04:10:50,674 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-18 04:10:50,674 INFO [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 04:10:50,676 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,676 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,676 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,676 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,677 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:50,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,676 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:50,676 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:50,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:50,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:50,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:10:50,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:10:50,677 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:50,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:50,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:50,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:50,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:50,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:10:50,679 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:50,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 04:10:50,679 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:50,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:10:50,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 04:10:50,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:50,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:50,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:50,682 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:50,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:10:50,682 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:50,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 04:10:50,683 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:50,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:50,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:50,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:50,694 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:50,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:50,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:50,694 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:50,694 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:50,694 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:10:50,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:50,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:50,694 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:50,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:10:50,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:10:50,694 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,694 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:50,694 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:10:50,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:50,695 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:50,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:50,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:50,695 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:10:50,695 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:50,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:10:50,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:50,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:10:50,697 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,695 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-18 04:10:50,697 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-18 04:10:50,697 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:10:50,697 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-18 04:10:50,697 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,697 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:10:50,697 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:10:50,697 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,698 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,697 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-18 04:10:50,699 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230718d15a83ff9e3c48e0a345ab6227753965, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307188e339e8f77fb4f72a29afab4227ee691] mob files 2023-07-18 04:10:50,699 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230718d15a83ff9e3c48e0a345ab6227753965 2023-07-18 04:10:50,699 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307188e339e8f77fb4f72a29afab4227ee691 2023-07-18 04:10:50,710 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-18 04:10:50,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,748 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,783 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-18 04:10:50,783 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,783 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,783 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689653450526Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689653450710 (+184 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689653450710Loading Region manifests for snaptb0-testExportFileSystemState at 1689653450710Writing data manifest for snaptb0-testExportFileSystemState at 1689653450717 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689653450736 (+19 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689653450783 (+47 ms) 2023-07-18 04:10:50,786 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-18 04:10:50,789 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 259 msec 2023-07-18 04:10:50,830 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:10:50,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 04:10:50,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 04:10:50,832 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653450832 2023-07-18 04:10:50,832 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43229, tgtDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653450832, rawTgtDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653450832, srcFsUri=hdfs://localhost:43229, srcDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8 2023-07-18 04:10:50,857 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43229, inputRoot=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8 2023-07-18 04:10:50,857 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2046134075_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653450832, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653450832/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,857 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43229, inputRoot=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8, snapshotDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-18 04:10:50,869 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653450832/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-18 04:10:50,891 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:50,892 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:50,892 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:50,892 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:50,893 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:50,893 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:50,893 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:50,962 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/hadoop-5117395441461566476.jar 2023-07-18 04:10:50,963 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:50,963 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:50,964 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:50,964 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:50,964 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:50,965 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 04:10:50,965 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 04:10:50,966 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 04:10:50,967 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 04:10:50,967 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 04:10:50,968 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 04:10:50,968 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 04:10:50,969 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 04:10:50,969 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 04:10:50,969 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 04:10:50,970 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 04:10:50,970 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:10:50,971 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:10:50,971 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 04:10:50,971 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:10:50,971 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:10:50,972 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 04:10:50,972 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 04:10:51,405 WARN [Listener at jenkins-hbase4.apache.org/40435] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 04:10:51,408 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-18 04:10:51,410 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-18 04:10:53,648 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 04:10:53,649 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 04:10:53,655 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653430729_0001_000001 (auth:SIMPLE) 2023-07-18 04:10:54,043 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653430729_0002_000001 (auth:SIMPLE) 2023-07-18 04:10:54,531 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 04:10:58,484 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653430729_0002_000001 (auth:SIMPLE) 2023-07-18 04:11:00,757 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653430729_0002_000001 (auth:SIMPLE) 2023-07-18 04:11:04,402 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653430729_0002_000001 (auth:SIMPLE) 2023-07-18 04:11:05,749 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 04:11:05,750 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 04:11:05,762 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-18 04:11:05,763 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 04:11:05,763 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 04:11:05,764 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-559505343_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-18 04:11:05,764 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(367): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-18 04:11:05,764 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(367): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-18 04:11:05,764 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-559505343_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653450832/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653450832/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-18 04:11:05,765 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(367): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653450832/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-18 04:11:05,765 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(367): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653450832/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-18 04:11:05,775 INFO [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-18 04:11:05,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-18 04:11:05,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-18 04:11:05,782 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653465782"}]},"ts":"1689653465782"} 2023-07-18 04:11:05,784 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-18 04:11:05,785 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-18 04:11:05,786 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=67a6c7d4ffb4305cf120366efa7ce101, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0eab3326816fc0556519f61fcefc9437, UNASSIGN}] 2023-07-18 04:11:05,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-18 04:11:05,789 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0eab3326816fc0556519f61fcefc9437, UNASSIGN 2023-07-18 04:11:05,789 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=67a6c7d4ffb4305cf120366efa7ce101, UNASSIGN 2023-07-18 04:11:05,790 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=67a6c7d4ffb4305cf120366efa7ce101, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:05,790 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689653449463.67a6c7d4ffb4305cf120366efa7ce101.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689653465790"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653465790"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653465790"}]},"ts":"1689653465790"} 2023-07-18 04:11:05,790 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=0eab3326816fc0556519f61fcefc9437, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:05,790 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689653449463.0eab3326816fc0556519f61fcefc9437.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689653465790"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653465790"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653465790"}]},"ts":"1689653465790"} 2023-07-18 04:11:05,792 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 67a6c7d4ffb4305cf120366efa7ce101, server=jenkins-hbase4.apache.org,35525,1689653423141}] 2023-07-18 04:11:05,793 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 0eab3326816fc0556519f61fcefc9437, server=jenkins-hbase4.apache.org,43385,1689653423267}] 2023-07-18 04:11:05,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-18 04:11:05,944 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0eab3326816fc0556519f61fcefc9437 2023-07-18 04:11:05,944 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 67a6c7d4ffb4305cf120366efa7ce101 2023-07-18 04:11:05,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0eab3326816fc0556519f61fcefc9437, disabling compactions & flushes 2023-07-18 04:11:05,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 67a6c7d4ffb4305cf120366efa7ce101, disabling compactions & flushes 2023-07-18 04:11:05,945 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689653449463.0eab3326816fc0556519f61fcefc9437. 2023-07-18 04:11:05,945 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689653449463.67a6c7d4ffb4305cf120366efa7ce101. 2023-07-18 04:11:05,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689653449463.0eab3326816fc0556519f61fcefc9437. 2023-07-18 04:11:05,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689653449463.67a6c7d4ffb4305cf120366efa7ce101. 2023-07-18 04:11:05,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689653449463.0eab3326816fc0556519f61fcefc9437. after waiting 0 ms 2023-07-18 04:11:05,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689653449463.0eab3326816fc0556519f61fcefc9437. 2023-07-18 04:11:05,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689653449463.67a6c7d4ffb4305cf120366efa7ce101. after waiting 0 ms 2023-07-18 04:11:05,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689653449463.67a6c7d4ffb4305cf120366efa7ce101. 2023-07-18 04:11:05,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemState/0eab3326816fc0556519f61fcefc9437/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 04:11:05,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemState/67a6c7d4ffb4305cf120366efa7ce101/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 04:11:05,961 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:11:05,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:11:05,962 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689653449463.0eab3326816fc0556519f61fcefc9437. 2023-07-18 04:11:05,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0eab3326816fc0556519f61fcefc9437: 2023-07-18 04:11:05,963 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689653449463.67a6c7d4ffb4305cf120366efa7ce101. 2023-07-18 04:11:05,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 67a6c7d4ffb4305cf120366efa7ce101: 2023-07-18 04:11:05,965 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0eab3326816fc0556519f61fcefc9437 2023-07-18 04:11:05,966 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=0eab3326816fc0556519f61fcefc9437, regionState=CLOSED 2023-07-18 04:11:05,966 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689653449463.0eab3326816fc0556519f61fcefc9437.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689653465966"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653465966"}]},"ts":"1689653465966"} 2023-07-18 04:11:05,966 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 67a6c7d4ffb4305cf120366efa7ce101 2023-07-18 04:11:05,968 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=67a6c7d4ffb4305cf120366efa7ce101, regionState=CLOSED 2023-07-18 04:11:05,968 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689653449463.67a6c7d4ffb4305cf120366efa7ce101.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689653465968"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653465968"}]},"ts":"1689653465968"} 2023-07-18 04:11:05,978 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-18 04:11:05,978 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 0eab3326816fc0556519f61fcefc9437, server=jenkins-hbase4.apache.org,43385,1689653423267 in 176 msec 2023-07-18 04:11:05,979 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-18 04:11:05,979 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 67a6c7d4ffb4305cf120366efa7ce101, server=jenkins-hbase4.apache.org,35525,1689653423141 in 178 msec 2023-07-18 04:11:05,980 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0eab3326816fc0556519f61fcefc9437, UNASSIGN in 192 msec 2023-07-18 04:11:05,981 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-18 04:11:05,981 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=67a6c7d4ffb4305cf120366efa7ce101, UNASSIGN in 193 msec 2023-07-18 04:11:05,982 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653465982"}]},"ts":"1689653465982"} 2023-07-18 04:11:05,984 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-18 04:11:05,986 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-18 04:11:05,988 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 212 msec 2023-07-18 04:11:06,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-18 04:11:06,092 INFO [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-18 04:11:06,093 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-18 04:11:06,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-18 04:11:06,099 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-18 04:11:06,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-18 04:11:06,101 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-18 04:11:06,103 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35525] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-18 04:11:06,107 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 04:11:06,107 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 04:11:06,107 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 04:11:06,107 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 04:11:06,108 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-18 04:11:06,108 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-18 04:11:06,108 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-18 04:11:06,108 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-18 04:11:06,108 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemState/67a6c7d4ffb4305cf120366efa7ce101 2023-07-18 04:11:06,108 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemState/0eab3326816fc0556519f61fcefc9437 2023-07-18 04:11:06,109 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 04:11:06,110 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:06,110 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 04:11:06,110 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:06,110 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 04:11:06,110 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:06,110 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 04:11:06,110 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:06,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-18 04:11:06,112 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemState/0eab3326816fc0556519f61fcefc9437/cf, FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemState/0eab3326816fc0556519f61fcefc9437/recovered.edits] 2023-07-18 04:11:06,113 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemState/67a6c7d4ffb4305cf120366efa7ce101/cf, FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemState/67a6c7d4ffb4305cf120366efa7ce101/recovered.edits] 2023-07-18 04:11:06,117 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemState/0eab3326816fc0556519f61fcefc9437/cf/59c1c7d3b6bd43c4bb41d8e27245d7ab to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/archive/data/default/testtb-testExportFileSystemState/0eab3326816fc0556519f61fcefc9437/cf/59c1c7d3b6bd43c4bb41d8e27245d7ab 2023-07-18 04:11:06,118 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemState/67a6c7d4ffb4305cf120366efa7ce101/cf/dcfabbc640aa4d7e8aebda5b3713b529 to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/archive/data/default/testtb-testExportFileSystemState/67a6c7d4ffb4305cf120366efa7ce101/cf/dcfabbc640aa4d7e8aebda5b3713b529 2023-07-18 04:11:06,121 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemState/0eab3326816fc0556519f61fcefc9437/recovered.edits/9.seqid to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/archive/data/default/testtb-testExportFileSystemState/0eab3326816fc0556519f61fcefc9437/recovered.edits/9.seqid 2023-07-18 04:11:06,122 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemState/67a6c7d4ffb4305cf120366efa7ce101/recovered.edits/9.seqid to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/archive/data/default/testtb-testExportFileSystemState/67a6c7d4ffb4305cf120366efa7ce101/recovered.edits/9.seqid 2023-07-18 04:11:06,122 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemState/0eab3326816fc0556519f61fcefc9437 2023-07-18 04:11:06,123 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemState/67a6c7d4ffb4305cf120366efa7ce101 2023-07-18 04:11:06,123 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-18 04:11:06,123 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-18 04:11:06,124 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-18 04:11:06,128 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230718d15a83ff9e3c48e0a345ab6227753965 to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230718d15a83ff9e3c48e0a345ab6227753965 2023-07-18 04:11:06,130 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307188e339e8f77fb4f72a29afab4227ee691 to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307188e339e8f77fb4f72a29afab4227ee691 2023-07-18 04:11:06,130 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-18 04:11:06,133 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-18 04:11:06,136 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-18 04:11:06,139 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-18 04:11:06,141 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-18 04:11:06,141 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-18 04:11:06,141 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689653449463.67a6c7d4ffb4305cf120366efa7ce101.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689653466141"}]},"ts":"9223372036854775807"} 2023-07-18 04:11:06,141 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689653449463.0eab3326816fc0556519f61fcefc9437.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689653466141"}]},"ts":"9223372036854775807"} 2023-07-18 04:11:06,143 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-18 04:11:06,144 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 67a6c7d4ffb4305cf120366efa7ce101, NAME => 'testtb-testExportFileSystemState,,1689653449463.67a6c7d4ffb4305cf120366efa7ce101.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0eab3326816fc0556519f61fcefc9437, NAME => 'testtb-testExportFileSystemState,1,1689653449463.0eab3326816fc0556519f61fcefc9437.', STARTKEY => '1', ENDKEY => ''}] 2023-07-18 04:11:06,144 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-18 04:11:06,144 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689653466144"}]},"ts":"9223372036854775807"} 2023-07-18 04:11:06,146 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-18 04:11:06,148 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-18 04:11:06,149 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 55 msec 2023-07-18 04:11:06,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-18 04:11:06,216 INFO [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-18 04:11:06,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-18 04:11:06,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-18 04:11:06,230 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-18 04:11:06,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-18 04:11:06,273 INFO [Listener at jenkins-hbase4.apache.org/40435] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=761 (was 753) Potentially hanging thread: Thread-2025 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (1966361669) connection to jenkins-hbase4.apache.org/172.31.14.131:35795 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-559505343_17 at /127.0.0.1:50416 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xf2856f0-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-559505343_17 at /127.0.0.1:38584 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1523408063_1 at /127.0.0.1:50396 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xf2856f0-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-559505343_17 at /127.0.0.1:55778 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1966361669) connection to jenkins-hbase4.apache.org/172.31.14.131:33917 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0xf2856f0-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xf2856f0-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1523408063_1 at /127.0.0.1:38568 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=941 (was 920) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=364 (was 249) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 184), AvailableMemoryMB=2662 (was 3009) 2023-07-18 04:11:06,273 WARN [Listener at jenkins-hbase4.apache.org/40435] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-18 04:11:06,305 INFO [Listener at jenkins-hbase4.apache.org/40435] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=761, OpenFileDescriptor=941, MaxFileDescriptor=60000, SystemLoadAverage=364, ProcessCount=184, AvailableMemoryMB=2658 2023-07-18 04:11:06,305 WARN [Listener at jenkins-hbase4.apache.org/40435] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-18 04:11:06,309 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-18 04:11:06,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-18 04:11:06,319 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 04:11:06,321 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 04:11:06,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-18 04:11:06,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-18 04:11:06,327 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testConsecutiveExports/a56557cbdacac72bae780aba34bd46e9 2023-07-18 04:11:06,327 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testConsecutiveExports/a56557cbdacac72bae780aba34bd46e9 empty. 2023-07-18 04:11:06,327 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testConsecutiveExports/5af2f4ce1c0f5416cdb72341bb324ef6 2023-07-18 04:11:06,328 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testConsecutiveExports/a56557cbdacac72bae780aba34bd46e9 2023-07-18 04:11:06,335 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testConsecutiveExports/5af2f4ce1c0f5416cdb72341bb324ef6 empty. 2023-07-18 04:11:06,336 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testConsecutiveExports/5af2f4ce1c0f5416cdb72341bb324ef6 2023-07-18 04:11:06,336 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-18 04:11:06,381 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-18 04:11:06,383 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => a56557cbdacac72bae780aba34bd46e9, NAME => 'testtb-testConsecutiveExports,,1689653466309.a56557cbdacac72bae780aba34bd46e9.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp 2023-07-18 04:11:06,393 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 5af2f4ce1c0f5416cdb72341bb324ef6, NAME => 'testtb-testConsecutiveExports,1,1689653466309.5af2f4ce1c0f5416cdb72341bb324ef6.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp 2023-07-18 04:11:06,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-18 04:11:06,430 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689653466309.a56557cbdacac72bae780aba34bd46e9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:11:06,430 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing a56557cbdacac72bae780aba34bd46e9, disabling compactions & flushes 2023-07-18 04:11:06,431 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689653466309.a56557cbdacac72bae780aba34bd46e9. 2023-07-18 04:11:06,431 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689653466309.a56557cbdacac72bae780aba34bd46e9. 2023-07-18 04:11:06,431 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689653466309.5af2f4ce1c0f5416cdb72341bb324ef6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:11:06,431 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 5af2f4ce1c0f5416cdb72341bb324ef6, disabling compactions & flushes 2023-07-18 04:11:06,431 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689653466309.5af2f4ce1c0f5416cdb72341bb324ef6. 2023-07-18 04:11:06,431 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689653466309.5af2f4ce1c0f5416cdb72341bb324ef6. 2023-07-18 04:11:06,431 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689653466309.5af2f4ce1c0f5416cdb72341bb324ef6. after waiting 0 ms 2023-07-18 04:11:06,431 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689653466309.5af2f4ce1c0f5416cdb72341bb324ef6. 2023-07-18 04:11:06,431 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689653466309.5af2f4ce1c0f5416cdb72341bb324ef6. 2023-07-18 04:11:06,431 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 5af2f4ce1c0f5416cdb72341bb324ef6: 2023-07-18 04:11:06,431 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689653466309.a56557cbdacac72bae780aba34bd46e9. after waiting 0 ms 2023-07-18 04:11:06,432 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689653466309.a56557cbdacac72bae780aba34bd46e9. 2023-07-18 04:11:06,432 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689653466309.a56557cbdacac72bae780aba34bd46e9. 2023-07-18 04:11:06,432 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for a56557cbdacac72bae780aba34bd46e9: 2023-07-18 04:11:06,435 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 04:11:06,436 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689653466309.5af2f4ce1c0f5416cdb72341bb324ef6.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689653466436"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653466436"}]},"ts":"1689653466436"} 2023-07-18 04:11:06,436 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689653466309.a56557cbdacac72bae780aba34bd46e9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689653466436"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653466436"}]},"ts":"1689653466436"} 2023-07-18 04:11:06,440 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 04:11:06,443 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 04:11:06,443 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653466443"}]},"ts":"1689653466443"} 2023-07-18 04:11:06,447 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-18 04:11:06,451 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 04:11:06,452 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 04:11:06,452 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 04:11:06,452 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 04:11:06,452 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 04:11:06,452 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a56557cbdacac72bae780aba34bd46e9, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5af2f4ce1c0f5416cdb72341bb324ef6, ASSIGN}] 2023-07-18 04:11:06,456 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5af2f4ce1c0f5416cdb72341bb324ef6, ASSIGN 2023-07-18 04:11:06,456 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a56557cbdacac72bae780aba34bd46e9, ASSIGN 2023-07-18 04:11:06,457 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5af2f4ce1c0f5416cdb72341bb324ef6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43385,1689653423267; forceNewPlan=false, retain=false 2023-07-18 04:11:06,458 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a56557cbdacac72bae780aba34bd46e9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35525,1689653423141; forceNewPlan=false, retain=false 2023-07-18 04:11:06,608 INFO [jenkins-hbase4:46231] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 04:11:06,610 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=5af2f4ce1c0f5416cdb72341bb324ef6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:06,610 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=a56557cbdacac72bae780aba34bd46e9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:06,611 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689653466309.5af2f4ce1c0f5416cdb72341bb324ef6.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689653466610"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653466610"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653466610"}]},"ts":"1689653466610"} 2023-07-18 04:11:06,611 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689653466309.a56557cbdacac72bae780aba34bd46e9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689653466610"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653466610"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653466610"}]},"ts":"1689653466610"} 2023-07-18 04:11:06,613 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 5af2f4ce1c0f5416cdb72341bb324ef6, server=jenkins-hbase4.apache.org,43385,1689653423267}] 2023-07-18 04:11:06,614 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure a56557cbdacac72bae780aba34bd46e9, server=jenkins-hbase4.apache.org,35525,1689653423141}] 2023-07-18 04:11:06,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-18 04:11:06,769 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689653466309.5af2f4ce1c0f5416cdb72341bb324ef6. 2023-07-18 04:11:06,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5af2f4ce1c0f5416cdb72341bb324ef6, NAME => 'testtb-testConsecutiveExports,1,1689653466309.5af2f4ce1c0f5416cdb72341bb324ef6.', STARTKEY => '1', ENDKEY => ''} 2023-07-18 04:11:06,770 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689653466309.a56557cbdacac72bae780aba34bd46e9. 2023-07-18 04:11:06,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689653466309.5af2f4ce1c0f5416cdb72341bb324ef6. service=AccessControlService 2023-07-18 04:11:06,771 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:11:06,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 5af2f4ce1c0f5416cdb72341bb324ef6 2023-07-18 04:11:06,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689653466309.5af2f4ce1c0f5416cdb72341bb324ef6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:11:06,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5af2f4ce1c0f5416cdb72341bb324ef6 2023-07-18 04:11:06,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5af2f4ce1c0f5416cdb72341bb324ef6 2023-07-18 04:11:06,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a56557cbdacac72bae780aba34bd46e9, NAME => 'testtb-testConsecutiveExports,,1689653466309.a56557cbdacac72bae780aba34bd46e9.', STARTKEY => '', ENDKEY => '1'} 2023-07-18 04:11:06,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689653466309.a56557cbdacac72bae780aba34bd46e9. service=AccessControlService 2023-07-18 04:11:06,772 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:11:06,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports a56557cbdacac72bae780aba34bd46e9 2023-07-18 04:11:06,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689653466309.a56557cbdacac72bae780aba34bd46e9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:11:06,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a56557cbdacac72bae780aba34bd46e9 2023-07-18 04:11:06,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a56557cbdacac72bae780aba34bd46e9 2023-07-18 04:11:06,774 INFO [StoreOpener-5af2f4ce1c0f5416cdb72341bb324ef6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5af2f4ce1c0f5416cdb72341bb324ef6 2023-07-18 04:11:06,774 INFO [StoreOpener-a56557cbdacac72bae780aba34bd46e9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a56557cbdacac72bae780aba34bd46e9 2023-07-18 04:11:06,776 DEBUG [StoreOpener-a56557cbdacac72bae780aba34bd46e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testConsecutiveExports/a56557cbdacac72bae780aba34bd46e9/cf 2023-07-18 04:11:06,776 DEBUG [StoreOpener-a56557cbdacac72bae780aba34bd46e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testConsecutiveExports/a56557cbdacac72bae780aba34bd46e9/cf 2023-07-18 04:11:06,776 INFO [StoreOpener-a56557cbdacac72bae780aba34bd46e9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a56557cbdacac72bae780aba34bd46e9 columnFamilyName cf 2023-07-18 04:11:06,778 DEBUG [StoreOpener-5af2f4ce1c0f5416cdb72341bb324ef6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testConsecutiveExports/5af2f4ce1c0f5416cdb72341bb324ef6/cf 2023-07-18 04:11:06,778 DEBUG [StoreOpener-5af2f4ce1c0f5416cdb72341bb324ef6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testConsecutiveExports/5af2f4ce1c0f5416cdb72341bb324ef6/cf 2023-07-18 04:11:06,778 INFO [StoreOpener-a56557cbdacac72bae780aba34bd46e9-1] regionserver.HStore(310): Store=a56557cbdacac72bae780aba34bd46e9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:11:06,778 INFO [StoreOpener-5af2f4ce1c0f5416cdb72341bb324ef6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5af2f4ce1c0f5416cdb72341bb324ef6 columnFamilyName cf 2023-07-18 04:11:06,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testConsecutiveExports/a56557cbdacac72bae780aba34bd46e9 2023-07-18 04:11:06,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testConsecutiveExports/a56557cbdacac72bae780aba34bd46e9 2023-07-18 04:11:06,781 INFO [StoreOpener-5af2f4ce1c0f5416cdb72341bb324ef6-1] regionserver.HStore(310): Store=5af2f4ce1c0f5416cdb72341bb324ef6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:11:06,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testConsecutiveExports/5af2f4ce1c0f5416cdb72341bb324ef6 2023-07-18 04:11:06,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testConsecutiveExports/5af2f4ce1c0f5416cdb72341bb324ef6 2023-07-18 04:11:06,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a56557cbdacac72bae780aba34bd46e9 2023-07-18 04:11:06,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testConsecutiveExports/a56557cbdacac72bae780aba34bd46e9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 04:11:06,786 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a56557cbdacac72bae780aba34bd46e9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71242279, jitterRate=0.06159268319606781}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 04:11:06,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a56557cbdacac72bae780aba34bd46e9: 2023-07-18 04:11:06,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5af2f4ce1c0f5416cdb72341bb324ef6 2023-07-18 04:11:06,787 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689653466309.a56557cbdacac72bae780aba34bd46e9., pid=46, masterSystemTime=1689653466765 2023-07-18 04:11:06,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testConsecutiveExports/5af2f4ce1c0f5416cdb72341bb324ef6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 04:11:06,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689653466309.a56557cbdacac72bae780aba34bd46e9. 2023-07-18 04:11:06,790 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689653466309.a56557cbdacac72bae780aba34bd46e9. 2023-07-18 04:11:06,790 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5af2f4ce1c0f5416cdb72341bb324ef6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70415288, jitterRate=0.04926955699920654}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 04:11:06,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5af2f4ce1c0f5416cdb72341bb324ef6: 2023-07-18 04:11:06,790 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=a56557cbdacac72bae780aba34bd46e9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:06,791 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689653466309.a56557cbdacac72bae780aba34bd46e9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689653466790"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689653466790"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689653466790"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689653466790"}]},"ts":"1689653466790"} 2023-07-18 04:11:06,792 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689653466309.5af2f4ce1c0f5416cdb72341bb324ef6., pid=45, masterSystemTime=1689653466765 2023-07-18 04:11:06,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689653466309.5af2f4ce1c0f5416cdb72341bb324ef6. 2023-07-18 04:11:06,794 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689653466309.5af2f4ce1c0f5416cdb72341bb324ef6. 2023-07-18 04:11:06,795 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=5af2f4ce1c0f5416cdb72341bb324ef6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:06,795 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689653466309.5af2f4ce1c0f5416cdb72341bb324ef6.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689653466795"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689653466795"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689653466795"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689653466795"}]},"ts":"1689653466795"} 2023-07-18 04:11:06,796 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-18 04:11:06,796 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure a56557cbdacac72bae780aba34bd46e9, server=jenkins-hbase4.apache.org,35525,1689653423141 in 179 msec 2023-07-18 04:11:06,799 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a56557cbdacac72bae780aba34bd46e9, ASSIGN in 345 msec 2023-07-18 04:11:06,801 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-18 04:11:06,801 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 5af2f4ce1c0f5416cdb72341bb324ef6, server=jenkins-hbase4.apache.org,43385,1689653423267 in 185 msec 2023-07-18 04:11:06,803 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-18 04:11:06,803 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5af2f4ce1c0f5416cdb72341bb324ef6, ASSIGN in 349 msec 2023-07-18 04:11:06,804 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 04:11:06,804 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653466804"}]},"ts":"1689653466804"} 2023-07-18 04:11:06,806 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-18 04:11:06,809 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 04:11:06,809 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-18 04:11:06,811 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35525] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-18 04:11:06,813 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:06,813 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:06,813 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:06,813 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:06,814 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-18 04:11:06,814 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-18 04:11:06,814 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-18 04:11:06,815 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-18 04:11:06,817 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 505 msec 2023-07-18 04:11:06,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-18 04:11:06,929 INFO [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-18 04:11:06,932 DEBUG [Listener at jenkins-hbase4.apache.org/40435] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-18 04:11:06,932 DEBUG [Listener at jenkins-hbase4.apache.org/40435] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689653466309.a56557cbdacac72bae780aba34bd46e9. 2023-07-18 04:11:06,934 INFO [Listener at jenkins-hbase4.apache.org/40435] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 04:11:06,949 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-18 04:11:06,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689653466949 (current time:1689653466949). 2023-07-18 04:11:06,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 04:11:06,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(139): Connect 0x6d62a1c8 to 127.0.0.1:64260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:11:06,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c06ac31, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:11:06,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:11:06,961 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45096, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:11:06,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6d62a1c8 to 127.0.0.1:64260 2023-07-18 04:11:06,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:11:06,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(139): Connect 0x1a6fb7f9 to 127.0.0.1:64260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:11:06,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@627b299d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:11:06,970 DEBUG [hconnection-0xb7576c7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:11:06,973 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45104, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:11:06,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:11:06,981 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43434, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:11:06,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1a6fb7f9 to 127.0.0.1:64260 2023-07-18 04:11:06,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:11:06,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-18 04:11:06,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 04:11:06,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-18 04:11:06,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-18 04:11:06,987 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-18 04:11:06,989 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689654066989 2023-07-18 04:11:06,989 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-18 04:11:06,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-18 04:11:06,992 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 04:11:06,992 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 04:11:06,995 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-18 04:11:06,996 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-18 04:11:06,998 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 11 msec 2023-07-18 04:11:06,999 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-18 04:11:07,000 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689654067000 2023-07-18 04:11:07,092 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:11:07,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-18 04:11:07,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:11:07,094 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 04:11:07,294 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:11:07,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-18 04:11:07,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:11:07,295 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 04:11:07,418 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,418 INFO [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-18 04:11:07,418 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:11:07,418 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-18 04:11:07,418 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-18 04:11:07,419 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,419 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,421 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:07,421 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:07,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:07,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:07,421 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:07,421 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:07,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:07,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:07,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:07,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:07,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,421 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:07,422 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:07,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,422 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,422 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:07,422 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 04:11:07,422 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-18 04:11:07,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,422 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,423 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-18 04:11:07,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-18 04:11:07,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-18 04:11:07,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,423 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-18 04:11:07,423 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,423 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-18 04:11:07,423 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-18 04:11:07,423 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,423 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:11:07,423 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-18 04:11:07,425 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:11:07,425 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-18 04:11:07,423 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,426 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-18 04:11:07,426 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-18 04:11:07,426 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-18 04:11:07,426 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-18 04:11:07,426 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:11:07,426 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42889,1689653423206' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-18 04:11:07,429 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-18 04:11:07,429 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-18 04:11:07,426 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43385,1689653423267' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-18 04:11:07,429 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35525,1689653423141' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-18 04:11:07,431 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,432 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:07,432 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:07,432 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:07,432 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:11:07,432 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,432 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:07,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:07,432 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,432 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,432 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:11:07,432 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:11:07,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:07,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:07,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:07,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:07,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:07,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:07,434 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35525,1689653423141' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-18 04:11:07,434 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78297f0c[Count = 1] remaining members to acquire global barrier 2023-07-18 04:11:07,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:07,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:07,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:07,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:07,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:07,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:07,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:07,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:07,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:07,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43385,1689653423267' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-18 04:11:07,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78297f0c[Count = 0] remaining members to acquire global barrier 2023-07-18 04:11:07,437 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-18 04:11:07,437 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,438 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,438 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,438 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,438 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-18 04:11:07,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,438 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-18 04:11:07,438 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:07,439 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689653466309.5af2f4ce1c0f5416cdb72341bb324ef6. 2023-07-18 04:11:07,439 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-18 04:11:07,438 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:11:07,439 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:11:07,439 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689653466309.a56557cbdacac72bae780aba34bd46e9. 2023-07-18 04:11:07,439 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689653466309.5af2f4ce1c0f5416cdb72341bb324ef6. started... 2023-07-18 04:11:07,439 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-18 04:11:07,439 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:07,439 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 04:11:07,439 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:11:07,439 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:11:07,439 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42889,1689653423206' in zk 2023-07-18 04:11:07,439 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689653466309.a56557cbdacac72bae780aba34bd46e9. started... 2023-07-18 04:11:07,440 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5af2f4ce1c0f5416cdb72341bb324ef6: 2023-07-18 04:11:07,441 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a56557cbdacac72bae780aba34bd46e9: 2023-07-18 04:11:07,441 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689653466309.5af2f4ce1c0f5416cdb72341bb324ef6.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,441 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:11:07,441 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 04:11:07,441 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689653466309.a56557cbdacac72bae780aba34bd46e9.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,442 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:11:07,442 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 04:11:07,451 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-18 04:11:07,451 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:11:07,451 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-18 04:11:07,474 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689653466309.5af2f4ce1c0f5416cdb72341bb324ef6. completed. 2023-07-18 04:11:07,474 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689653466309.5af2f4ce1c0f5416cdb72341bb324ef6. 2023-07-18 04:11:07,474 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:11:07,474 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:11:07,474 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:07,474 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-18 04:11:07,474 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43385,1689653423267' in zk 2023-07-18 04:11:07,476 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-18 04:11:07,476 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:07,476 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:11:07,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:07,476 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-18 04:11:07,476 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689653466309.a56557cbdacac72bae780aba34bd46e9. completed. 2023-07-18 04:11:07,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:07,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:07,478 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689653466309.a56557cbdacac72bae780aba34bd46e9. 2023-07-18 04:11:07,478 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:11:07,478 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:11:07,479 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:07,479 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-18 04:11:07,479 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35525,1689653423141' in zk 2023-07-18 04:11:07,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:07,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:07,480 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-18 04:11:07,480 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:11:07,480 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-18 04:11:07,482 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:07,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:07,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:07,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:07,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:07,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:07,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:07,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:07,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43385,1689653423267': 2023-07-18 04:11:07,485 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43385,1689653423267' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-18 04:11:07,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:07,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:07,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:07,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:07,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:07,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:07,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:07,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:07,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:07,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:07,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:07,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:07,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,35525,1689653423141': 2023-07-18 04:11:07,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35525,1689653423141' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-18 04:11:07,489 INFO [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-18 04:11:07,489 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 04:11:07,489 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 04:11:07,489 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,489 INFO [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 04:11:07,492 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,492 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,492 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:07,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,492 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,492 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,492 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:07,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:07,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:07,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,492 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:07,492 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:07,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:07,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:07,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:07,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:07,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:07,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:07,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:07,493 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:07,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,494 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:07,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:07,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:07,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:07,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:07,502 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:07,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:07,502 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:07,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,503 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:07,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:07,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:07,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:07,507 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:07,507 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,507 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:07,507 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:07,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:07,507 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:07,507 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:07,508 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:11:07,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:07,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:07,507 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:07,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:07,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:07,508 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:07,508 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,508 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:07,507 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:07,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:07,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:07,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:07,510 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,510 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-18 04:11:07,510 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:07,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:07,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:07,511 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,511 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:07,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:07,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:07,511 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,511 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:07,511 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-18 04:11:07,511 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,511 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,512 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-18 04:11:07,521 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,521 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,540 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,558 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-18 04:11:07,558 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,558 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:07,558 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689653466990Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689653467521 (+531 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689653467521Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689653467521Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689653467524 (+3 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689653467533 (+9 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689653467558 (+25 ms) 2023-07-18 04:11:07,563 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-18 04:11:07,563 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-18 04:11:07,565 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 572 msec 2023-07-18 04:11:07,596 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:11:07,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-18 04:11:07,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 04:11:07,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35525] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689653466309.a56557cbdacac72bae780aba34bd46e9. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 04:11:07,601 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43385] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689653466309.5af2f4ce1c0f5416cdb72341bb324ef6. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 04:11:07,603 DEBUG [Listener at jenkins-hbase4.apache.org/40435] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-18 04:11:07,604 DEBUG [Listener at jenkins-hbase4.apache.org/40435] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689653466309.a56557cbdacac72bae780aba34bd46e9. 2023-07-18 04:11:07,604 INFO [Listener at jenkins-hbase4.apache.org/40435] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 04:11:07,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-18 04:11:07,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689653467614 (current time:1689653467614). 2023-07-18 04:11:07,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 04:11:07,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(139): Connect 0x1316210d to 127.0.0.1:64260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:11:07,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@275567f3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:11:07,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:11:07,630 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45120, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:11:07,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1316210d to 127.0.0.1:64260 2023-07-18 04:11:07,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:11:07,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(139): Connect 0x1bbb5628 to 127.0.0.1:64260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:11:07,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3907021b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:11:07,739 DEBUG [hconnection-0x35e18037-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:11:07,742 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45132, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:11:07,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:11:07,747 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43442, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:11:07,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1bbb5628 to 127.0.0.1:64260 2023-07-18 04:11:07,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:11:07,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-18 04:11:07,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 04:11:07,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-18 04:11:07,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-18 04:11:07,752 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-18 04:11:07,752 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689654067752 2023-07-18 04:11:07,752 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-18 04:11:07,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-18 04:11:07,754 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 04:11:07,754 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 04:11:07,755 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-18 04:11:07,755 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-18 04:11:07,757 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-07-18 04:11:07,757 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-18 04:11:07,758 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689654067758 2023-07-18 04:11:07,771 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-18 04:11:07,771 INFO [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-18 04:11:07,771 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:11:07,772 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-18 04:11:07,772 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-18 04:11:07,773 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,773 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,774 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:07,774 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:07,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:07,774 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:07,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:07,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:07,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:07,774 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:07,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:07,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:07,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,774 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:07,775 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:07,775 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,775 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,775 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,775 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:07,775 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 04:11:07,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-18 04:11:07,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-18 04:11:07,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-18 04:11:07,775 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-18 04:11:07,775 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-18 04:11:07,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,776 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-18 04:11:07,776 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-18 04:11:07,776 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-18 04:11:07,776 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:11:07,778 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-18 04:11:07,778 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-18 04:11:07,778 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-18 04:11:07,778 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-18 04:11:07,779 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-18 04:11:07,779 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:11:07,778 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-18 04:11:07,780 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:11:07,779 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-18 04:11:07,780 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-18 04:11:07,780 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-18 04:11:07,780 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42889,1689653423206' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-18 04:11:07,779 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35525,1689653423141' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-18 04:11:07,780 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-18 04:11:07,780 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43385,1689653423267' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-18 04:11:07,782 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,782 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,782 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:07,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:07,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:07,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:07,784 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:07,784 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,784 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,784 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:11:07,784 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,784 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:11:07,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:07,784 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,784 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:11:07,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:07,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 04:11:07,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:07,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:07,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:07,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:07,786 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43385,1689653423267' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-18 04:11:07,786 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ae7ff7a[Count = 1] remaining members to acquire global barrier 2023-07-18 04:11:07,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:07,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:07,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:07,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:07,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:07,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 04:11:07,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:07,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:07,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:07,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:07,788 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35525,1689653423141' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-18 04:11:07,788 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ae7ff7a[Count = 0] remaining members to acquire global barrier 2023-07-18 04:11:07,788 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-18 04:11:07,788 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,789 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,789 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,789 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,789 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:07,789 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-18 04:11:07,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,789 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-18 04:11:07,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,789 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-18 04:11:07,789 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42889,1689653423206' in zk 2023-07-18 04:11:07,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,789 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:07,789 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-18 04:11:07,789 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 04:11:07,790 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:11:07,790 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:11:07,790 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:11:07,790 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:11:07,790 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689653466309.a56557cbdacac72bae780aba34bd46e9. 2023-07-18 04:11:07,790 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689653466309.5af2f4ce1c0f5416cdb72341bb324ef6. 2023-07-18 04:11:07,790 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689653466309.a56557cbdacac72bae780aba34bd46e9. started... 2023-07-18 04:11:07,790 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689653466309.5af2f4ce1c0f5416cdb72341bb324ef6. started... 2023-07-18 04:11:07,790 INFO [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a56557cbdacac72bae780aba34bd46e9 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-18 04:11:07,790 INFO [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5af2f4ce1c0f5416cdb72341bb324ef6 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-18 04:11:07,791 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-18 04:11:07,791 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:11:07,791 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-18 04:11:07,819 INFO [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071801d8c330eba84819a0c22aac48edcb1c to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023071801d8c330eba84819a0c22aac48edcb1c 2023-07-18 04:11:07,822 INFO [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307180615f762262c445199a48f0388a11795 to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307180615f762262c445199a48f0388a11795 2023-07-18 04:11:07,828 INFO [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testConsecutiveExports/a56557cbdacac72bae780aba34bd46e9/.tmp/cf/36b6ecac9f6d4502a9642a57a1601e1a 2023-07-18 04:11:07,830 INFO [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testConsecutiveExports/5af2f4ce1c0f5416cdb72341bb324ef6/.tmp/cf/e2f8ccde23384bd2a554dd02217a5841 2023-07-18 04:11:07,834 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testConsecutiveExports/a56557cbdacac72bae780aba34bd46e9/.tmp/cf/36b6ecac9f6d4502a9642a57a1601e1a as hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testConsecutiveExports/a56557cbdacac72bae780aba34bd46e9/cf/36b6ecac9f6d4502a9642a57a1601e1a 2023-07-18 04:11:07,836 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testConsecutiveExports/5af2f4ce1c0f5416cdb72341bb324ef6/.tmp/cf/e2f8ccde23384bd2a554dd02217a5841 as hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testConsecutiveExports/5af2f4ce1c0f5416cdb72341bb324ef6/cf/e2f8ccde23384bd2a554dd02217a5841 2023-07-18 04:11:07,840 INFO [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testConsecutiveExports/a56557cbdacac72bae780aba34bd46e9/cf/36b6ecac9f6d4502a9642a57a1601e1a, entries=2, sequenceid=6, filesize=5.2 K 2023-07-18 04:11:07,841 INFO [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for a56557cbdacac72bae780aba34bd46e9 in 51ms, sequenceid=6, compaction requested=false 2023-07-18 04:11:07,842 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a56557cbdacac72bae780aba34bd46e9: 2023-07-18 04:11:07,843 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689653466309.a56557cbdacac72bae780aba34bd46e9.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-18 04:11:07,843 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:11:07,843 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testConsecutiveExports/a56557cbdacac72bae780aba34bd46e9/cf/36b6ecac9f6d4502a9642a57a1601e1a] hfiles 2023-07-18 04:11:07,843 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testConsecutiveExports/a56557cbdacac72bae780aba34bd46e9/cf/36b6ecac9f6d4502a9642a57a1601e1a for snapshot=snaptb0-testConsecutiveExports 2023-07-18 04:11:07,843 INFO [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testConsecutiveExports/5af2f4ce1c0f5416cdb72341bb324ef6/cf/e2f8ccde23384bd2a554dd02217a5841, entries=48, sequenceid=6, filesize=12.9 K 2023-07-18 04:11:07,844 INFO [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 5af2f4ce1c0f5416cdb72341bb324ef6 in 54ms, sequenceid=6, compaction requested=false 2023-07-18 04:11:07,844 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5af2f4ce1c0f5416cdb72341bb324ef6: 2023-07-18 04:11:07,844 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689653466309.5af2f4ce1c0f5416cdb72341bb324ef6.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-18 04:11:07,844 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:11:07,844 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testConsecutiveExports/5af2f4ce1c0f5416cdb72341bb324ef6/cf/e2f8ccde23384bd2a554dd02217a5841] hfiles 2023-07-18 04:11:07,845 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testConsecutiveExports/5af2f4ce1c0f5416cdb72341bb324ef6/cf/e2f8ccde23384bd2a554dd02217a5841 for snapshot=snaptb0-testConsecutiveExports 2023-07-18 04:11:07,851 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689653466309.a56557cbdacac72bae780aba34bd46e9. completed. 2023-07-18 04:11:07,851 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689653466309.a56557cbdacac72bae780aba34bd46e9. 2023-07-18 04:11:07,851 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:11:07,851 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:11:07,851 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:07,851 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-18 04:11:07,851 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35525,1689653423141' in zk 2023-07-18 04:11:07,852 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689653466309.5af2f4ce1c0f5416cdb72341bb324ef6. completed. 2023-07-18 04:11:07,852 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689653466309.5af2f4ce1c0f5416cdb72341bb324ef6. 2023-07-18 04:11:07,852 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:11:07,853 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:11:07,853 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:07,853 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-18 04:11:07,853 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43385,1689653423267' in zk 2023-07-18 04:11:07,853 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-18 04:11:07,853 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:07,853 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:11:07,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:07,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:07,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:07,855 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:11:07,853 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-18 04:11:07,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-18 04:11:07,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:11:07,856 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 04:11:07,857 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:07,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:07,857 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-18 04:11:07,857 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:11:07,857 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-18 04:11:07,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:07,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 04:11:07,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:07,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:07,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:07,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:07,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 04:11:07,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:07,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:07,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:07,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,35525,1689653423141': 2023-07-18 04:11:07,861 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35525,1689653423141' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-18 04:11:07,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:07,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:07,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:07,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:07,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:07,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 04:11:07,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:07,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:07,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:07,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:07,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 04:11:07,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:07,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:07,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:07,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43385,1689653423267': 2023-07-18 04:11:07,865 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43385,1689653423267' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-18 04:11:07,865 INFO [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-18 04:11:07,865 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 04:11:07,865 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 04:11:07,865 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-18 04:11:07,865 INFO [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 04:11:07,866 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,866 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,866 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:07,866 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:07,867 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,866 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:07,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:07,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,867 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:07,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,867 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:07,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:07,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:07,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:07,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:07,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:07,867 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:07,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:07,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:07,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 04:11:07,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,868 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:07,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:07,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 04:11:07,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:07,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:07,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:07,870 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:07,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:07,870 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:07,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 04:11:07,871 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:07,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:07,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:07,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:07,877 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:07,877 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:07,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:07,877 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:07,877 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:07,877 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,877 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:07,877 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:07,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:07,877 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:07,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:07,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:07,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:07,877 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-18 04:11:07,877 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:11:07,877 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:07,877 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:07,877 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:07,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:07,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:07,879 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:07,878 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-18 04:11:07,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:07,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:07,879 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,880 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:07,880 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:07,880 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,880 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:07,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:07,879 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-18 04:11:07,880 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-18 04:11:07,881 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307180615f762262c445199a48f0388a11795, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023071801d8c330eba84819a0c22aac48edcb1c] mob files 2023-07-18 04:11:07,881 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307180615f762262c445199a48f0388a11795 2023-07-18 04:11:07,881 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023071801d8c330eba84819a0c22aac48edcb1c 2023-07-18 04:11:07,888 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-18 04:11:07,889 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,908 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,935 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-18 04:11:07,935 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,935 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 04:11:07,935 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689653467752Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689653467888 (+136 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689653467888Loading Region manifests for snaptb0-testConsecutiveExports at 1689653467888Writing data manifest for snaptb0-testConsecutiveExports at 1689653467892 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689653467901 (+9 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689653467935 (+34 ms) 2023-07-18 04:11:07,938 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-18 04:11:07,940 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 185 msec 2023-07-18 04:11:08,056 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:11:08,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-18 04:11:08,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 04:11:08,058 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/local-export-1689653468058 2023-07-18 04:11:08,058 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/local-export-1689653468058, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/local-export-1689653468058, srcFsUri=hdfs://localhost:43229, srcDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8 2023-07-18 04:11:08,080 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43229, inputRoot=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8 2023-07-18 04:11:08,081 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@7c028d62, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/local-export-1689653468058, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/local-export-1689653468058/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 04:11:08,081 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43229, inputRoot=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8, snapshotDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-18 04:11:08,089 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/local-export-1689653468058/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 04:11:08,100 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:08,101 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:08,101 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:08,101 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:08,101 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:08,102 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:08,102 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:08,170 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/hadoop-1136229439387204.jar 2023-07-18 04:11:08,171 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:08,171 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:08,171 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:08,172 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:08,172 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:08,172 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:08,173 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 04:11:08,173 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 04:11:08,173 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 04:11:08,174 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 04:11:08,174 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 04:11:08,174 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 04:11:08,175 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 04:11:08,175 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 04:11:08,175 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 04:11:08,176 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 04:11:08,176 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:11:08,177 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:11:08,177 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 04:11:08,177 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:11:08,177 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:11:08,178 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 04:11:08,178 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 04:11:08,937 WARN [Listener at jenkins-hbase4.apache.org/40435] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 04:11:08,939 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-18 04:11:08,941 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-18 04:11:10,585 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 04:11:10,585 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 04:11:10,588 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653430729_0002_000001 (auth:SIMPLE) 2023-07-18 04:11:11,397 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653430729_0003_000001 (auth:SIMPLE) 2023-07-18 04:11:11,540 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 04:11:15,470 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653430729_0003_000001 (auth:SIMPLE) 2023-07-18 04:11:17,746 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653430729_0003_000001 (auth:SIMPLE) 2023-07-18 04:11:21,193 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653430729_0003_000001 (auth:SIMPLE) 2023-07-18 04:11:23,128 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 04:11:23,128 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 04:11:23,133 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-18 04:11:23,133 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 04:11:23,133 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 04:11:23,133 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-559505343_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-18 04:11:23,134 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(367): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-18 04:11:23,134 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(367): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-18 04:11:23,134 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@2e40b77f in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/local-export-1689653468058/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/local-export-1689653468058/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-18 04:11:23,135 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/local-export-1689653468058/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-18 04:11:23,135 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/local-export-1689653468058/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-18 04:11:23,136 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/local-export-1689653468058, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/local-export-1689653468058, srcFsUri=hdfs://localhost:43229, srcDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8 2023-07-18 04:11:23,160 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43229, inputRoot=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8 2023-07-18 04:11:23,161 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@2b714764, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/local-export-1689653468058, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/local-export-1689653468058/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 04:11:23,161 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43229, inputRoot=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8, snapshotDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-18 04:11:23,177 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/local-export-1689653468058/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 04:11:23,191 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:23,192 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:23,192 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:23,193 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:23,193 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:23,194 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:23,194 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:23,279 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/hadoop-2475482222093418398.jar 2023-07-18 04:11:23,279 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:23,280 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:23,280 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:23,281 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:23,281 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:23,281 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:23,282 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 04:11:23,282 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 04:11:23,283 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 04:11:23,283 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 04:11:23,284 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 04:11:23,284 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 04:11:23,285 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 04:11:23,285 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 04:11:23,286 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 04:11:23,286 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 04:11:23,287 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:11:23,287 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:11:23,288 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 04:11:23,288 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:11:23,288 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:11:23,289 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 04:11:23,289 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 04:11:23,699 WARN [Listener at jenkins-hbase4.apache.org/40435] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 04:11:23,704 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-18 04:11:23,706 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-18 04:11:27,379 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 04:11:27,379 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 04:11:27,382 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653430729_0003_000001 (auth:SIMPLE) 2023-07-18 04:11:28,156 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653430729_0004_000001 (auth:SIMPLE) 2023-07-18 04:11:32,223 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653430729_0004_000001 (auth:SIMPLE) 2023-07-18 04:11:34,519 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653430729_0004_000001 (auth:SIMPLE) 2023-07-18 04:11:37,977 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653430729_0004_000001 (auth:SIMPLE) 2023-07-18 04:11:39,910 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 04:11:39,910 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 04:11:39,915 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-18 04:11:39,915 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 04:11:39,916 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 04:11:39,916 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-559505343_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-18 04:11:39,925 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(367): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-18 04:11:39,925 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(367): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-18 04:11:39,925 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@2e40b77f in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/local-export-1689653468058/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/local-export-1689653468058/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-18 04:11:39,925 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/local-export-1689653468058/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-18 04:11:39,925 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/local-export-1689653468058/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-18 04:11:39,940 INFO [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-18 04:11:39,940 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-18 04:11:39,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-18 04:11:39,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-18 04:11:39,947 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653499947"}]},"ts":"1689653499947"} 2023-07-18 04:11:39,948 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-18 04:11:39,951 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-18 04:11:39,952 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a56557cbdacac72bae780aba34bd46e9, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5af2f4ce1c0f5416cdb72341bb324ef6, UNASSIGN}] 2023-07-18 04:11:39,955 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a56557cbdacac72bae780aba34bd46e9, UNASSIGN 2023-07-18 04:11:39,955 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5af2f4ce1c0f5416cdb72341bb324ef6, UNASSIGN 2023-07-18 04:11:39,956 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=a56557cbdacac72bae780aba34bd46e9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:39,956 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689653466309.a56557cbdacac72bae780aba34bd46e9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689653499956"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653499956"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653499956"}]},"ts":"1689653499956"} 2023-07-18 04:11:39,957 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=5af2f4ce1c0f5416cdb72341bb324ef6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:39,958 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689653466309.5af2f4ce1c0f5416cdb72341bb324ef6.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689653499957"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653499957"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653499957"}]},"ts":"1689653499957"} 2023-07-18 04:11:39,959 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure a56557cbdacac72bae780aba34bd46e9, server=jenkins-hbase4.apache.org,35525,1689653423141}] 2023-07-18 04:11:39,960 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 5af2f4ce1c0f5416cdb72341bb324ef6, server=jenkins-hbase4.apache.org,43385,1689653423267}] 2023-07-18 04:11:40,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-18 04:11:40,112 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a56557cbdacac72bae780aba34bd46e9 2023-07-18 04:11:40,112 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5af2f4ce1c0f5416cdb72341bb324ef6 2023-07-18 04:11:40,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a56557cbdacac72bae780aba34bd46e9, disabling compactions & flushes 2023-07-18 04:11:40,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5af2f4ce1c0f5416cdb72341bb324ef6, disabling compactions & flushes 2023-07-18 04:11:40,112 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689653466309.5af2f4ce1c0f5416cdb72341bb324ef6. 2023-07-18 04:11:40,112 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689653466309.a56557cbdacac72bae780aba34bd46e9. 2023-07-18 04:11:40,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689653466309.5af2f4ce1c0f5416cdb72341bb324ef6. 2023-07-18 04:11:40,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689653466309.a56557cbdacac72bae780aba34bd46e9. 2023-07-18 04:11:40,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689653466309.5af2f4ce1c0f5416cdb72341bb324ef6. after waiting 0 ms 2023-07-18 04:11:40,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689653466309.a56557cbdacac72bae780aba34bd46e9. after waiting 0 ms 2023-07-18 04:11:40,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689653466309.5af2f4ce1c0f5416cdb72341bb324ef6. 2023-07-18 04:11:40,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689653466309.a56557cbdacac72bae780aba34bd46e9. 2023-07-18 04:11:40,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testConsecutiveExports/5af2f4ce1c0f5416cdb72341bb324ef6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 04:11:40,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:11:40,137 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689653466309.5af2f4ce1c0f5416cdb72341bb324ef6. 2023-07-18 04:11:40,137 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5af2f4ce1c0f5416cdb72341bb324ef6: 2023-07-18 04:11:40,141 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5af2f4ce1c0f5416cdb72341bb324ef6 2023-07-18 04:11:40,141 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=5af2f4ce1c0f5416cdb72341bb324ef6, regionState=CLOSED 2023-07-18 04:11:40,142 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689653466309.5af2f4ce1c0f5416cdb72341bb324ef6.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689653500141"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653500141"}]},"ts":"1689653500141"} 2023-07-18 04:11:40,146 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-18 04:11:40,146 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 5af2f4ce1c0f5416cdb72341bb324ef6, server=jenkins-hbase4.apache.org,43385,1689653423267 in 183 msec 2023-07-18 04:11:40,146 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testConsecutiveExports/a56557cbdacac72bae780aba34bd46e9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 04:11:40,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:11:40,148 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5af2f4ce1c0f5416cdb72341bb324ef6, UNASSIGN in 194 msec 2023-07-18 04:11:40,149 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689653466309.a56557cbdacac72bae780aba34bd46e9. 2023-07-18 04:11:40,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a56557cbdacac72bae780aba34bd46e9: 2023-07-18 04:11:40,152 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=a56557cbdacac72bae780aba34bd46e9, regionState=CLOSED 2023-07-18 04:11:40,153 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689653466309.a56557cbdacac72bae780aba34bd46e9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689653500152"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653500152"}]},"ts":"1689653500152"} 2023-07-18 04:11:40,155 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a56557cbdacac72bae780aba34bd46e9 2023-07-18 04:11:40,158 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-18 04:11:40,158 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure a56557cbdacac72bae780aba34bd46e9, server=jenkins-hbase4.apache.org,35525,1689653423141 in 196 msec 2023-07-18 04:11:40,161 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-18 04:11:40,161 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a56557cbdacac72bae780aba34bd46e9, UNASSIGN in 206 msec 2023-07-18 04:11:40,162 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653500162"}]},"ts":"1689653500162"} 2023-07-18 04:11:40,165 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-18 04:11:40,166 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-18 04:11:40,172 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 227 msec 2023-07-18 04:11:40,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-18 04:11:40,247 INFO [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-18 04:11:40,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-18 04:11:40,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-18 04:11:40,251 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-18 04:11:40,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-18 04:11:40,252 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-18 04:11:40,255 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35525] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-18 04:11:40,258 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 04:11:40,258 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 04:11:40,258 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 04:11:40,258 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 04:11:40,258 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-18 04:11:40,259 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-18 04:11:40,262 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testConsecutiveExports/a56557cbdacac72bae780aba34bd46e9 2023-07-18 04:11:40,263 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testConsecutiveExports/5af2f4ce1c0f5416cdb72341bb324ef6 2023-07-18 04:11:40,263 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-18 04:11:40,263 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-18 04:11:40,265 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 04:11:40,265 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 04:11:40,265 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:40,265 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:40,265 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 04:11:40,265 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:40,265 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 04:11:40,265 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:40,267 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testConsecutiveExports/5af2f4ce1c0f5416cdb72341bb324ef6/cf, FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testConsecutiveExports/5af2f4ce1c0f5416cdb72341bb324ef6/recovered.edits] 2023-07-18 04:11:40,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-18 04:11:40,268 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testConsecutiveExports/a56557cbdacac72bae780aba34bd46e9/cf, FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testConsecutiveExports/a56557cbdacac72bae780aba34bd46e9/recovered.edits] 2023-07-18 04:11:40,275 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testConsecutiveExports/a56557cbdacac72bae780aba34bd46e9/cf/36b6ecac9f6d4502a9642a57a1601e1a to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/archive/data/default/testtb-testConsecutiveExports/a56557cbdacac72bae780aba34bd46e9/cf/36b6ecac9f6d4502a9642a57a1601e1a 2023-07-18 04:11:40,275 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testConsecutiveExports/5af2f4ce1c0f5416cdb72341bb324ef6/cf/e2f8ccde23384bd2a554dd02217a5841 to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/archive/data/default/testtb-testConsecutiveExports/5af2f4ce1c0f5416cdb72341bb324ef6/cf/e2f8ccde23384bd2a554dd02217a5841 2023-07-18 04:11:40,279 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testConsecutiveExports/a56557cbdacac72bae780aba34bd46e9/recovered.edits/9.seqid to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/archive/data/default/testtb-testConsecutiveExports/a56557cbdacac72bae780aba34bd46e9/recovered.edits/9.seqid 2023-07-18 04:11:40,279 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testConsecutiveExports/5af2f4ce1c0f5416cdb72341bb324ef6/recovered.edits/9.seqid to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/archive/data/default/testtb-testConsecutiveExports/5af2f4ce1c0f5416cdb72341bb324ef6/recovered.edits/9.seqid 2023-07-18 04:11:40,280 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testConsecutiveExports/a56557cbdacac72bae780aba34bd46e9 2023-07-18 04:11:40,280 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testConsecutiveExports/5af2f4ce1c0f5416cdb72341bb324ef6 2023-07-18 04:11:40,280 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-18 04:11:40,281 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-18 04:11:40,282 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-18 04:11:40,285 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307180615f762262c445199a48f0388a11795 to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307180615f762262c445199a48f0388a11795 2023-07-18 04:11:40,287 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023071801d8c330eba84819a0c22aac48edcb1c to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023071801d8c330eba84819a0c22aac48edcb1c 2023-07-18 04:11:40,287 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-18 04:11:40,290 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-18 04:11:40,293 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-18 04:11:40,296 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-18 04:11:40,297 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-18 04:11:40,297 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-18 04:11:40,297 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689653466309.a56557cbdacac72bae780aba34bd46e9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689653500297"}]},"ts":"9223372036854775807"} 2023-07-18 04:11:40,297 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689653466309.5af2f4ce1c0f5416cdb72341bb324ef6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689653500297"}]},"ts":"9223372036854775807"} 2023-07-18 04:11:40,299 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-18 04:11:40,299 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a56557cbdacac72bae780aba34bd46e9, NAME => 'testtb-testConsecutiveExports,,1689653466309.a56557cbdacac72bae780aba34bd46e9.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 5af2f4ce1c0f5416cdb72341bb324ef6, NAME => 'testtb-testConsecutiveExports,1,1689653466309.5af2f4ce1c0f5416cdb72341bb324ef6.', STARTKEY => '1', ENDKEY => ''}] 2023-07-18 04:11:40,299 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-18 04:11:40,299 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689653500299"}]},"ts":"9223372036854775807"} 2023-07-18 04:11:40,301 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-18 04:11:40,303 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-18 04:11:40,305 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 55 msec 2023-07-18 04:11:40,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-18 04:11:40,369 INFO [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-18 04:11:40,379 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-18 04:11:40,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-18 04:11:40,382 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-18 04:11:40,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-18 04:11:40,414 INFO [Listener at jenkins-hbase4.apache.org/40435] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=743 (was 761), OpenFileDescriptor=909 (was 941), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=384 (was 364) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 184), AvailableMemoryMB=3300 (was 2658) - AvailableMemoryMB LEAK? - 2023-07-18 04:11:40,414 WARN [Listener at jenkins-hbase4.apache.org/40435] hbase.ResourceChecker(130): Thread=743 is superior to 500 2023-07-18 04:11:40,439 INFO [Listener at jenkins-hbase4.apache.org/40435] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=743, OpenFileDescriptor=909, MaxFileDescriptor=60000, SystemLoadAverage=384, ProcessCount=183, AvailableMemoryMB=3295 2023-07-18 04:11:40,439 WARN [Listener at jenkins-hbase4.apache.org/40435] hbase.ResourceChecker(130): Thread=743 is superior to 500 2023-07-18 04:11:40,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-18 04:11:40,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:40,446 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 04:11:40,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-18 04:11:40,447 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 04:11:40,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-18 04:11:40,450 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f14c4f673923b3da2f3c0a3a4cdc0b7 2023-07-18 04:11:40,450 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a9fcef8d4f90f1741eaf59bc0524756 2023-07-18 04:11:40,451 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f14c4f673923b3da2f3c0a3a4cdc0b7 empty. 2023-07-18 04:11:40,451 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a9fcef8d4f90f1741eaf59bc0524756 empty. 2023-07-18 04:11:40,452 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f14c4f673923b3da2f3c0a3a4cdc0b7 2023-07-18 04:11:40,456 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a9fcef8d4f90f1741eaf59bc0524756 2023-07-18 04:11:40,456 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-18 04:11:40,487 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-18 04:11:40,489 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6f14c4f673923b3da2f3c0a3a4cdc0b7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689653500441.6f14c4f673923b3da2f3c0a3a4cdc0b7.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp 2023-07-18 04:11:40,490 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0a9fcef8d4f90f1741eaf59bc0524756, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689653500441.0a9fcef8d4f90f1741eaf59bc0524756.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp 2023-07-18 04:11:40,546 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689653500441.6f14c4f673923b3da2f3c0a3a4cdc0b7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:11:40,546 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 6f14c4f673923b3da2f3c0a3a4cdc0b7, disabling compactions & flushes 2023-07-18 04:11:40,546 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689653500441.6f14c4f673923b3da2f3c0a3a4cdc0b7. 2023-07-18 04:11:40,546 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689653500441.6f14c4f673923b3da2f3c0a3a4cdc0b7. 2023-07-18 04:11:40,546 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689653500441.6f14c4f673923b3da2f3c0a3a4cdc0b7. after waiting 0 ms 2023-07-18 04:11:40,546 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689653500441.6f14c4f673923b3da2f3c0a3a4cdc0b7. 2023-07-18 04:11:40,546 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689653500441.6f14c4f673923b3da2f3c0a3a4cdc0b7. 2023-07-18 04:11:40,546 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 6f14c4f673923b3da2f3c0a3a4cdc0b7: 2023-07-18 04:11:40,550 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689653500441.0a9fcef8d4f90f1741eaf59bc0524756.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:11:40,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-18 04:11:40,550 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 0a9fcef8d4f90f1741eaf59bc0524756, disabling compactions & flushes 2023-07-18 04:11:40,550 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689653500441.0a9fcef8d4f90f1741eaf59bc0524756. 2023-07-18 04:11:40,550 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689653500441.0a9fcef8d4f90f1741eaf59bc0524756. 2023-07-18 04:11:40,550 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689653500441.0a9fcef8d4f90f1741eaf59bc0524756. after waiting 0 ms 2023-07-18 04:11:40,550 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689653500441.0a9fcef8d4f90f1741eaf59bc0524756. 2023-07-18 04:11:40,550 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689653500441.0a9fcef8d4f90f1741eaf59bc0524756. 2023-07-18 04:11:40,551 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 0a9fcef8d4f90f1741eaf59bc0524756: 2023-07-18 04:11:40,553 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 04:11:40,554 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689653500441.6f14c4f673923b3da2f3c0a3a4cdc0b7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689653500554"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653500554"}]},"ts":"1689653500554"} 2023-07-18 04:11:40,554 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689653500441.0a9fcef8d4f90f1741eaf59bc0524756.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689653500554"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653500554"}]},"ts":"1689653500554"} 2023-07-18 04:11:40,560 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 04:11:40,563 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 04:11:40,563 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653500563"}]},"ts":"1689653500563"} 2023-07-18 04:11:40,565 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-18 04:11:40,568 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 04:11:40,569 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 04:11:40,569 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 04:11:40,569 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 04:11:40,569 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 04:11:40,569 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6f14c4f673923b3da2f3c0a3a4cdc0b7, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0a9fcef8d4f90f1741eaf59bc0524756, ASSIGN}] 2023-07-18 04:11:40,572 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0a9fcef8d4f90f1741eaf59bc0524756, ASSIGN 2023-07-18 04:11:40,572 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6f14c4f673923b3da2f3c0a3a4cdc0b7, ASSIGN 2023-07-18 04:11:40,572 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0a9fcef8d4f90f1741eaf59bc0524756, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43385,1689653423267; forceNewPlan=false, retain=false 2023-07-18 04:11:40,573 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6f14c4f673923b3da2f3c0a3a4cdc0b7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42889,1689653423206; forceNewPlan=false, retain=false 2023-07-18 04:11:40,723 INFO [jenkins-hbase4:46231] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 04:11:40,726 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=6f14c4f673923b3da2f3c0a3a4cdc0b7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:40,726 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=0a9fcef8d4f90f1741eaf59bc0524756, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:40,726 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689653500441.6f14c4f673923b3da2f3c0a3a4cdc0b7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689653500726"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653500726"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653500726"}]},"ts":"1689653500726"} 2023-07-18 04:11:40,726 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689653500441.0a9fcef8d4f90f1741eaf59bc0524756.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689653500726"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653500726"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653500726"}]},"ts":"1689653500726"} 2023-07-18 04:11:40,728 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 6f14c4f673923b3da2f3c0a3a4cdc0b7, server=jenkins-hbase4.apache.org,42889,1689653423206}] 2023-07-18 04:11:40,729 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 0a9fcef8d4f90f1741eaf59bc0524756, server=jenkins-hbase4.apache.org,43385,1689653423267}] 2023-07-18 04:11:40,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-18 04:11:40,893 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689653500441.0a9fcef8d4f90f1741eaf59bc0524756. 2023-07-18 04:11:40,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0a9fcef8d4f90f1741eaf59bc0524756, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689653500441.0a9fcef8d4f90f1741eaf59bc0524756.', STARTKEY => '1', ENDKEY => ''} 2023-07-18 04:11:40,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689653500441.0a9fcef8d4f90f1741eaf59bc0524756. service=AccessControlService 2023-07-18 04:11:40,894 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:11:40,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 0a9fcef8d4f90f1741eaf59bc0524756 2023-07-18 04:11:40,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689653500441.0a9fcef8d4f90f1741eaf59bc0524756.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:11:40,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0a9fcef8d4f90f1741eaf59bc0524756 2023-07-18 04:11:40,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0a9fcef8d4f90f1741eaf59bc0524756 2023-07-18 04:11:40,895 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689653500441.6f14c4f673923b3da2f3c0a3a4cdc0b7. 2023-07-18 04:11:40,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6f14c4f673923b3da2f3c0a3a4cdc0b7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689653500441.6f14c4f673923b3da2f3c0a3a4cdc0b7.', STARTKEY => '', ENDKEY => '1'} 2023-07-18 04:11:40,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689653500441.6f14c4f673923b3da2f3c0a3a4cdc0b7. service=AccessControlService 2023-07-18 04:11:40,895 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:11:40,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 6f14c4f673923b3da2f3c0a3a4cdc0b7 2023-07-18 04:11:40,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689653500441.6f14c4f673923b3da2f3c0a3a4cdc0b7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:11:40,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6f14c4f673923b3da2f3c0a3a4cdc0b7 2023-07-18 04:11:40,896 INFO [StoreOpener-0a9fcef8d4f90f1741eaf59bc0524756-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0a9fcef8d4f90f1741eaf59bc0524756 2023-07-18 04:11:40,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6f14c4f673923b3da2f3c0a3a4cdc0b7 2023-07-18 04:11:40,898 DEBUG [StoreOpener-0a9fcef8d4f90f1741eaf59bc0524756-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a9fcef8d4f90f1741eaf59bc0524756/cf 2023-07-18 04:11:40,898 DEBUG [StoreOpener-0a9fcef8d4f90f1741eaf59bc0524756-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a9fcef8d4f90f1741eaf59bc0524756/cf 2023-07-18 04:11:40,899 INFO [StoreOpener-6f14c4f673923b3da2f3c0a3a4cdc0b7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6f14c4f673923b3da2f3c0a3a4cdc0b7 2023-07-18 04:11:40,900 INFO [StoreOpener-0a9fcef8d4f90f1741eaf59bc0524756-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0a9fcef8d4f90f1741eaf59bc0524756 columnFamilyName cf 2023-07-18 04:11:40,903 INFO [StoreOpener-0a9fcef8d4f90f1741eaf59bc0524756-1] regionserver.HStore(310): Store=0a9fcef8d4f90f1741eaf59bc0524756/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:11:40,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a9fcef8d4f90f1741eaf59bc0524756 2023-07-18 04:11:40,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a9fcef8d4f90f1741eaf59bc0524756 2023-07-18 04:11:40,907 DEBUG [StoreOpener-6f14c4f673923b3da2f3c0a3a4cdc0b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f14c4f673923b3da2f3c0a3a4cdc0b7/cf 2023-07-18 04:11:40,907 DEBUG [StoreOpener-6f14c4f673923b3da2f3c0a3a4cdc0b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f14c4f673923b3da2f3c0a3a4cdc0b7/cf 2023-07-18 04:11:40,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0a9fcef8d4f90f1741eaf59bc0524756 2023-07-18 04:11:40,913 INFO [StoreOpener-6f14c4f673923b3da2f3c0a3a4cdc0b7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6f14c4f673923b3da2f3c0a3a4cdc0b7 columnFamilyName cf 2023-07-18 04:11:40,915 INFO [StoreOpener-6f14c4f673923b3da2f3c0a3a4cdc0b7-1] regionserver.HStore(310): Store=6f14c4f673923b3da2f3c0a3a4cdc0b7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:11:40,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f14c4f673923b3da2f3c0a3a4cdc0b7 2023-07-18 04:11:40,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a9fcef8d4f90f1741eaf59bc0524756/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 04:11:40,923 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0a9fcef8d4f90f1741eaf59bc0524756; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70961670, jitterRate=0.05741128325462341}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 04:11:40,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0a9fcef8d4f90f1741eaf59bc0524756: 2023-07-18 04:11:40,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f14c4f673923b3da2f3c0a3a4cdc0b7 2023-07-18 04:11:40,925 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689653500441.0a9fcef8d4f90f1741eaf59bc0524756., pid=61, masterSystemTime=1689653500881 2023-07-18 04:11:40,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689653500441.0a9fcef8d4f90f1741eaf59bc0524756. 2023-07-18 04:11:40,929 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689653500441.0a9fcef8d4f90f1741eaf59bc0524756. 2023-07-18 04:11:40,930 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=0a9fcef8d4f90f1741eaf59bc0524756, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:40,930 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689653500441.0a9fcef8d4f90f1741eaf59bc0524756.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689653500930"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689653500930"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689653500930"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689653500930"}]},"ts":"1689653500930"} 2023-07-18 04:11:40,935 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-18 04:11:40,936 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 0a9fcef8d4f90f1741eaf59bc0524756, server=jenkins-hbase4.apache.org,43385,1689653423267 in 204 msec 2023-07-18 04:11:40,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6f14c4f673923b3da2f3c0a3a4cdc0b7 2023-07-18 04:11:40,937 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0a9fcef8d4f90f1741eaf59bc0524756, ASSIGN in 367 msec 2023-07-18 04:11:40,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f14c4f673923b3da2f3c0a3a4cdc0b7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 04:11:40,940 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6f14c4f673923b3da2f3c0a3a4cdc0b7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70799383, jitterRate=0.05499301850795746}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 04:11:40,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6f14c4f673923b3da2f3c0a3a4cdc0b7: 2023-07-18 04:11:40,941 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689653500441.6f14c4f673923b3da2f3c0a3a4cdc0b7., pid=60, masterSystemTime=1689653500880 2023-07-18 04:11:40,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689653500441.6f14c4f673923b3da2f3c0a3a4cdc0b7. 2023-07-18 04:11:40,946 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689653500441.6f14c4f673923b3da2f3c0a3a4cdc0b7. 2023-07-18 04:11:40,950 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=6f14c4f673923b3da2f3c0a3a4cdc0b7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:40,950 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689653500441.6f14c4f673923b3da2f3c0a3a4cdc0b7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689653500950"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689653500950"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689653500950"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689653500950"}]},"ts":"1689653500950"} 2023-07-18 04:11:40,954 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-18 04:11:40,954 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 6f14c4f673923b3da2f3c0a3a4cdc0b7, server=jenkins-hbase4.apache.org,42889,1689653423206 in 224 msec 2023-07-18 04:11:40,959 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-18 04:11:40,959 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6f14c4f673923b3da2f3c0a3a4cdc0b7, ASSIGN in 385 msec 2023-07-18 04:11:40,960 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 04:11:40,960 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653500960"}]},"ts":"1689653500960"} 2023-07-18 04:11:40,961 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-18 04:11:40,965 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 04:11:40,965 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-18 04:11:40,967 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35525] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-18 04:11:40,969 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:40,969 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:40,969 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:40,969 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:40,972 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:40,972 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:40,972 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:40,972 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:40,972 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 04:11:40,973 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 04:11:40,973 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 04:11:40,973 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 04:11:40,974 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 531 msec 2023-07-18 04:11:41,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-18 04:11:41,053 INFO [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-18 04:11:41,056 DEBUG [Listener at jenkins-hbase4.apache.org/40435] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,056 DEBUG [Listener at jenkins-hbase4.apache.org/40435] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689653500441.6f14c4f673923b3da2f3c0a3a4cdc0b7. 2023-07-18 04:11:41,060 INFO [Listener at jenkins-hbase4.apache.org/40435] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 04:11:41,075 DEBUG [hconnection-0x1ab66b66-shared-pool-22] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:11:41,081 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42210, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:11:41,094 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-18 04:11:41,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689653501094 (current time:1689653501094). 2023-07-18 04:11:41,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 04:11:41,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(139): Connect 0x36d52914 to 127.0.0.1:64260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:11:41,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e98f5ea, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:11:41,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:11:41,127 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34998, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:11:41,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x36d52914 to 127.0.0.1:64260 2023-07-18 04:11:41,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:11:41,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(139): Connect 0x5647ee9d to 127.0.0.1:64260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:11:41,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4945e0c8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:11:41,187 DEBUG [hconnection-0x704b7baf-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:11:41,188 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35004, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:11:41,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:11:41,210 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40488, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:11:41,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5647ee9d to 127.0.0.1:64260 2023-07-18 04:11:41,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:11:41,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-18 04:11:41,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 04:11:41,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-18 04:11:41,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-18 04:11:41,217 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-18 04:11:41,218 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689654101218 2023-07-18 04:11:41,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-18 04:11:41,220 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,220 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 04:11:41,220 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 04:11:41,224 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-18 04:11:41,224 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-18 04:11:41,226 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 10 msec 2023-07-18 04:11:41,228 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-18 04:11:41,229 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689654101229 2023-07-18 04:11:41,265 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,265 INFO [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-18 04:11:41,265 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:11:41,267 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-18 04:11:41,267 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-18 04:11:41,268 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,268 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,271 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:41,271 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:41,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:41,271 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:41,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:41,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:41,271 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:41,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:41,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:41,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:41,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,272 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:41,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,272 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:41,272 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,272 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:41,272 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 04:11:41,272 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-18 04:11:41,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,272 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,273 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-18 04:11:41,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-18 04:11:41,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,273 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,273 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-18 04:11:41,273 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-18 04:11:41,273 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:11:41,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-18 04:11:41,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,274 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,276 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-18 04:11:41,276 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-18 04:11:41,276 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-18 04:11:41,276 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-18 04:11:41,276 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,276 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-18 04:11:41,276 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:11:41,278 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-18 04:11:41,278 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-18 04:11:41,278 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35525,1689653423141' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-18 04:11:41,276 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:11:41,276 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42889,1689653423206' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-18 04:11:41,281 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-18 04:11:41,281 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-18 04:11:41,281 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43385,1689653423267' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-18 04:11:41,281 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:41,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:41,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:41,282 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:41,282 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,283 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:41,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:41,283 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,283 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,283 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:11:41,283 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,283 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:11:41,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:41,284 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,284 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:11:41,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:41,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:41,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:41,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:41,287 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42889,1689653423206' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-18 04:11:41,287 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f6a9dc7[Count = 1] remaining members to acquire global barrier 2023-07-18 04:11:41,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:41,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:41,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:41,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:41,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:41,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:41,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:41,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:41,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:41,298 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43385,1689653423267' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-18 04:11:41,298 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f6a9dc7[Count = 0] remaining members to acquire global barrier 2023-07-18 04:11:41,299 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-18 04:11:41,299 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,303 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,303 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,303 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,303 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-18 04:11:41,303 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-18 04:11:41,303 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-18 04:11:41,303 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:41,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,303 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35525,1689653423141' in zk 2023-07-18 04:11:41,303 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-18 04:11:41,303 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:11:41,304 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:11:41,304 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:11:41,304 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:11:41,304 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689653500441.6f14c4f673923b3da2f3c0a3a4cdc0b7. 2023-07-18 04:11:41,304 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689653500441.6f14c4f673923b3da2f3c0a3a4cdc0b7. started... 2023-07-18 04:11:41,304 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:41,304 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 04:11:41,304 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689653500441.0a9fcef8d4f90f1741eaf59bc0524756. 2023-07-18 04:11:41,304 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689653500441.0a9fcef8d4f90f1741eaf59bc0524756. started... 2023-07-18 04:11:41,304 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6f14c4f673923b3da2f3c0a3a4cdc0b7: 2023-07-18 04:11:41,306 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689653500441.6f14c4f673923b3da2f3c0a3a4cdc0b7.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,306 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:11:41,306 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 04:11:41,306 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0a9fcef8d4f90f1741eaf59bc0524756: 2023-07-18 04:11:41,307 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689653500441.0a9fcef8d4f90f1741eaf59bc0524756.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,307 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:11:41,307 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 04:11:41,312 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-18 04:11:41,312 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:11:41,313 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-18 04:11:41,320 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:11:41,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-18 04:11:41,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:11:41,322 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 04:11:41,333 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689653500441.6f14c4f673923b3da2f3c0a3a4cdc0b7. completed. 2023-07-18 04:11:41,333 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689653500441.6f14c4f673923b3da2f3c0a3a4cdc0b7. 2023-07-18 04:11:41,333 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:11:41,333 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:11:41,333 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:41,333 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-18 04:11:41,333 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42889,1689653423206' in zk 2023-07-18 04:11:41,334 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689653500441.0a9fcef8d4f90f1741eaf59bc0524756. completed. 2023-07-18 04:11:41,334 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689653500441.0a9fcef8d4f90f1741eaf59bc0524756. 2023-07-18 04:11:41,334 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:11:41,334 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:11:41,334 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:41,334 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-18 04:11:41,334 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43385,1689653423267' in zk 2023-07-18 04:11:41,335 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:41,335 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-18 04:11:41,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:41,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:41,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:41,335 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:11:41,335 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-18 04:11:41,342 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-18 04:11:41,342 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:11:41,342 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-18 04:11:41,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:41,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:41,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,345 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:41,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:41,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:41,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:41,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:41,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:41,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:41,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:41,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,42889,1689653423206': 2023-07-18 04:11:41,350 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42889,1689653423206' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-18 04:11:41,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:41,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:41,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:41,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:41,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:41,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:41,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:41,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:41,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:41,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:41,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:41,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:41,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43385,1689653423267': 2023-07-18 04:11:41,356 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43385,1689653423267' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-18 04:11:41,356 INFO [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-18 04:11:41,356 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 04:11:41,356 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 04:11:41,356 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,356 INFO [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 04:11:41,358 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,358 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,358 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:41,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:41,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,358 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:41,358 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:41,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,358 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:41,359 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:41,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,359 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:41,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:41,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:41,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,359 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:41,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:41,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:41,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:41,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:41,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:41,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,360 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:41,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:41,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:41,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:41,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:41,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,364 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:41,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:41,364 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:41,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:41,365 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:41,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:41,374 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:41,374 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:41,374 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:41,374 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:41,374 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:41,375 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:41,375 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,375 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:41,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:41,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:41,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:41,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:41,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:41,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:41,379 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:41,379 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:41,379 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,379 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:41,379 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,379 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,379 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:41,379 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,379 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:11:41,379 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,381 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-18 04:11:41,379 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:41,381 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,381 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:41,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:41,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:41,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:41,382 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-18 04:11:41,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:41,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:41,412 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,413 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,503 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,522 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:11:41,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-18 04:11:41,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:11:41,524 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 04:11:41,538 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-18 04:11:41,538 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,539 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,539 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689653501220Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689653501412 (+192 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689653501412Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689653501412Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689653501420 (+8 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689653501495 (+75 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689653501538 (+43 ms) 2023-07-18 04:11:41,541 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-18 04:11:41,543 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 319 msec 2023-07-18 04:11:41,824 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:11:41,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-18 04:11:41,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 04:11:41,835 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42889] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689653500441.6f14c4f673923b3da2f3c0a3a4cdc0b7. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 04:11:41,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43385] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689653500441.0a9fcef8d4f90f1741eaf59bc0524756. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 04:11:41,843 DEBUG [Listener at jenkins-hbase4.apache.org/40435] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,843 DEBUG [Listener at jenkins-hbase4.apache.org/40435] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689653500441.6f14c4f673923b3da2f3c0a3a4cdc0b7. 2023-07-18 04:11:41,843 INFO [Listener at jenkins-hbase4.apache.org/40435] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 04:11:41,855 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-18 04:11:41,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689653501855 (current time:1689653501855). 2023-07-18 04:11:41,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 04:11:41,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(139): Connect 0x75195e5d to 127.0.0.1:64260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:11:41,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c143770, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:11:41,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:11:41,889 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35018, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:11:41,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75195e5d to 127.0.0.1:64260 2023-07-18 04:11:41,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:11:41,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(139): Connect 0x355b131e to 127.0.0.1:64260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:11:41,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a0f485e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:11:41,922 DEBUG [hconnection-0x577d41d8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:11:41,926 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35028, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:11:41,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:11:41,941 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40492, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:11:41,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x355b131e to 127.0.0.1:64260 2023-07-18 04:11:41,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:11:41,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-18 04:11:41,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 04:11:41,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-18 04:11:41,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-18 04:11:41,947 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-18 04:11:41,948 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689654101948 2023-07-18 04:11:41,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-18 04:11:41,948 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,950 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 04:11:41,950 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 04:11:41,950 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-18 04:11:41,951 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-18 04:11:41,952 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-18 04:11:41,953 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-18 04:11:41,954 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689654101954 2023-07-18 04:11:41,967 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,967 INFO [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-18 04:11:41,967 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:11:41,968 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-18 04:11:41,968 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-18 04:11:41,969 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,969 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,970 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:41,970 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:41,970 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:41,970 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:41,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:41,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:41,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:41,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:41,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:41,971 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:41,971 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:41,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:41,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,971 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,971 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,971 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:41,971 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 04:11:41,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-18 04:11:41,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-18 04:11:41,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,972 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,972 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-18 04:11:41,972 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-18 04:11:41,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-18 04:11:41,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,972 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-18 04:11:41,978 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,978 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-18 04:11:41,979 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:11:41,980 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-18 04:11:41,980 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-18 04:11:41,980 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43385,1689653423267' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-18 04:11:41,980 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,980 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,980 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-18 04:11:41,980 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:11:41,981 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-18 04:11:41,982 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:11:41,982 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-18 04:11:41,982 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-18 04:11:41,982 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35525,1689653423141' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-18 04:11:41,983 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-18 04:11:41,983 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-18 04:11:41,983 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42889,1689653423206' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-18 04:11:41,984 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:41,984 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:41,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:41,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:41,985 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:41,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:41,986 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,986 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:11:41,986 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,986 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:41,986 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,986 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:11:41,986 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,987 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:11:41,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:41,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:41,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:41,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:41,989 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43385,1689653423267' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-18 04:11:41,989 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d121ce6[Count = 1] remaining members to acquire global barrier 2023-07-18 04:11:41,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:41,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:41,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:41,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:41,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:41,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:41,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:41,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:41,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:41,992 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42889,1689653423206' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-18 04:11:41,992 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d121ce6[Count = 0] remaining members to acquire global barrier 2023-07-18 04:11:41,992 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-18 04:11:41,992 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,996 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,996 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,998 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,999 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-18 04:11:41,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:41,999 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-18 04:11:41,999 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-18 04:11:41,999 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35525,1689653423141' in zk 2023-07-18 04:11:42,000 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-18 04:11:42,003 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:42,003 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-18 04:11:42,003 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:11:42,003 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-18 04:11:42,003 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:42,003 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 04:11:42,008 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:11:42,015 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689653500441.0a9fcef8d4f90f1741eaf59bc0524756. 2023-07-18 04:11:42,015 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689653500441.0a9fcef8d4f90f1741eaf59bc0524756. started... 2023-07-18 04:11:42,015 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689653500441.6f14c4f673923b3da2f3c0a3a4cdc0b7. 2023-07-18 04:11:42,014 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:11:42,015 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:11:42,015 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689653500441.6f14c4f673923b3da2f3c0a3a4cdc0b7. started... 2023-07-18 04:11:42,015 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:11:42,015 INFO [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0a9fcef8d4f90f1741eaf59bc0524756 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-18 04:11:42,015 INFO [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6f14c4f673923b3da2f3c0a3a4cdc0b7 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-18 04:11:42,050 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:11:42,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-18 04:11:42,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:11:42,051 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 04:11:42,106 INFO [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230718017d8584b9cd4ef89d8ffe9068e6a2c9 to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230718017d8584b9cd4ef89d8ffe9068e6a2c9 2023-07-18 04:11:42,145 INFO [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f14c4f673923b3da2f3c0a3a4cdc0b7/.tmp/cf/206801f0ea724235a9517ffab00cdda4 2023-07-18 04:11:42,145 INFO [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071895f3c9560cd54c0e8e675f8e7e275276 to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023071895f3c9560cd54c0e8e675f8e7e275276 2023-07-18 04:11:42,153 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f14c4f673923b3da2f3c0a3a4cdc0b7/.tmp/cf/206801f0ea724235a9517ffab00cdda4 as hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f14c4f673923b3da2f3c0a3a4cdc0b7/cf/206801f0ea724235a9517ffab00cdda4 2023-07-18 04:11:42,169 INFO [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f14c4f673923b3da2f3c0a3a4cdc0b7/cf/206801f0ea724235a9517ffab00cdda4, entries=4, sequenceid=6, filesize=5.6 K 2023-07-18 04:11:42,170 INFO [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 6f14c4f673923b3da2f3c0a3a4cdc0b7 in 155ms, sequenceid=6, compaction requested=false 2023-07-18 04:11:42,170 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-18 04:11:42,171 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6f14c4f673923b3da2f3c0a3a4cdc0b7: 2023-07-18 04:11:42,171 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689653500441.6f14c4f673923b3da2f3c0a3a4cdc0b7.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,171 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:11:42,171 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f14c4f673923b3da2f3c0a3a4cdc0b7/cf/206801f0ea724235a9517ffab00cdda4] hfiles 2023-07-18 04:11:42,171 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f14c4f673923b3da2f3c0a3a4cdc0b7/cf/206801f0ea724235a9517ffab00cdda4 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,179 INFO [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a9fcef8d4f90f1741eaf59bc0524756/.tmp/cf/6368b16d83c749978349190229173507 2023-07-18 04:11:42,202 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a9fcef8d4f90f1741eaf59bc0524756/.tmp/cf/6368b16d83c749978349190229173507 as hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a9fcef8d4f90f1741eaf59bc0524756/cf/6368b16d83c749978349190229173507 2023-07-18 04:11:42,214 INFO [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a9fcef8d4f90f1741eaf59bc0524756/cf/6368b16d83c749978349190229173507, entries=46, sequenceid=6, filesize=13.3 K 2023-07-18 04:11:42,215 INFO [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 0a9fcef8d4f90f1741eaf59bc0524756 in 200ms, sequenceid=6, compaction requested=false 2023-07-18 04:11:42,232 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0a9fcef8d4f90f1741eaf59bc0524756: 2023-07-18 04:11:42,232 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689653500441.0a9fcef8d4f90f1741eaf59bc0524756.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,232 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:11:42,233 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a9fcef8d4f90f1741eaf59bc0524756/cf/6368b16d83c749978349190229173507] hfiles 2023-07-18 04:11:42,233 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a9fcef8d4f90f1741eaf59bc0524756/cf/6368b16d83c749978349190229173507 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,238 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689653500441.6f14c4f673923b3da2f3c0a3a4cdc0b7. completed. 2023-07-18 04:11:42,239 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689653500441.6f14c4f673923b3da2f3c0a3a4cdc0b7. 2023-07-18 04:11:42,239 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:11:42,239 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:11:42,239 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:42,239 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-18 04:11:42,239 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42889,1689653423206' in zk 2023-07-18 04:11:42,241 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:42,241 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-18 04:11:42,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:42,241 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:11:42,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:42,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:42,241 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-18 04:11:42,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:42,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:42,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,252 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:11:42,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:42,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:42,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-18 04:11:42,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:42,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:11:42,253 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 04:11:42,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:42,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:42,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:42,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,42889,1689653423206': 2023-07-18 04:11:42,256 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42889,1689653423206' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-18 04:11:42,266 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689653500441.0a9fcef8d4f90f1741eaf59bc0524756. completed. 2023-07-18 04:11:42,266 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689653500441.0a9fcef8d4f90f1741eaf59bc0524756. 2023-07-18 04:11:42,266 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:11:42,267 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:11:42,267 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:42,267 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-18 04:11:42,267 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43385,1689653423267' in zk 2023-07-18 04:11:42,268 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:42,268 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-18 04:11:42,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:42,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:42,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:42,269 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:11:42,269 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-18 04:11:42,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:42,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:42,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:42,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:42,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:42,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:42,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:42,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:42,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:42,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43385,1689653423267': 2023-07-18 04:11:42,275 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43385,1689653423267' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-18 04:11:42,275 INFO [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-18 04:11:42,275 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 04:11:42,275 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 04:11:42,275 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,275 INFO [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 04:11:42,281 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,282 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:42,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,282 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,281 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,282 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:42,282 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:42,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,282 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:42,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:42,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:42,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:42,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:42,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:42,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:42,283 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:42,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:42,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,284 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:42,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:42,284 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:42,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:42,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:42,286 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:42,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:42,287 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:42,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:42,287 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:42,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:42,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:42,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:42,291 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:42,291 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:42,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:42,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:42,291 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:42,291 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:42,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:42,292 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:42,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:42,292 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:42,292 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:42,292 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,292 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:42,292 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:42,292 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,292 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:42,292 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:42,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:42,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:42,292 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:42,292 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:42,292 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:42,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:42,292 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:42,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:42,292 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:42,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:42,292 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:11:42,293 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,293 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,295 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-18 04:11:42,297 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion because node does not exist (not an error) 2023-07-18 04:11:42,298 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023071895f3c9560cd54c0e8e675f8e7e275276, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230718017d8584b9cd4ef89d8ffe9068e6a2c9] mob files 2023-07-18 04:11:42,298 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023071895f3c9560cd54c0e8e675f8e7e275276 2023-07-18 04:11:42,298 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230718017d8584b9cd4ef89d8ffe9068e6a2c9 2023-07-18 04:11:42,314 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,314 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,344 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,410 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-18 04:11:42,410 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,410 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:42,410 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689653501948Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689653502314 (+366 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689653502314Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689653502314Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689653502317 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689653502332 (+15 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689653502410 (+78 ms) 2023-07-18 04:11:42,416 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-18 04:11:42,417 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 467 msec 2023-07-18 04:11:42,554 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:11:42,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-18 04:11:42,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 04:11:42,592 DEBUG [Listener at jenkins-hbase4.apache.org/40435] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 04:11:42,596 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40506, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 04:11:42,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35525] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-18 04:11:42,599 DEBUG [Listener at jenkins-hbase4.apache.org/40435] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 04:11:42,605 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42214, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 04:11:42,605 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42889] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-18 04:11:42,606 DEBUG [Listener at jenkins-hbase4.apache.org/40435] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 04:11:42,614 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35042, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 04:11:42,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43385] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-18 04:11:42,618 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 04:11:42,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:42,628 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 04:11:42,628 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-18 04:11:42,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-18 04:11:42,633 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 04:11:42,639 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76f52aff44f0f1bc8e719b3c94d591b5 2023-07-18 04:11:42,639 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/069615b68f58945552baff6ee8b80812 2023-07-18 04:11:42,639 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76f52aff44f0f1bc8e719b3c94d591b5 empty. 2023-07-18 04:11:42,640 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/069615b68f58945552baff6ee8b80812 empty. 2023-07-18 04:11:42,640 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/069615b68f58945552baff6ee8b80812 2023-07-18 04:11:42,640 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76f52aff44f0f1bc8e719b3c94d591b5 2023-07-18 04:11:42,640 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-18 04:11:42,657 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-18 04:11:42,662 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 069615b68f58945552baff6ee8b80812, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653502618.069615b68f58945552baff6ee8b80812.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp 2023-07-18 04:11:42,662 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 76f52aff44f0f1bc8e719b3c94d591b5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502618.76f52aff44f0f1bc8e719b3c94d591b5.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp 2023-07-18 04:11:42,685 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502618.76f52aff44f0f1bc8e719b3c94d591b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:11:42,685 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 76f52aff44f0f1bc8e719b3c94d591b5, disabling compactions & flushes 2023-07-18 04:11:42,685 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502618.76f52aff44f0f1bc8e719b3c94d591b5. 2023-07-18 04:11:42,686 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502618.76f52aff44f0f1bc8e719b3c94d591b5. 2023-07-18 04:11:42,686 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502618.76f52aff44f0f1bc8e719b3c94d591b5. after waiting 0 ms 2023-07-18 04:11:42,686 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502618.76f52aff44f0f1bc8e719b3c94d591b5. 2023-07-18 04:11:42,686 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502618.76f52aff44f0f1bc8e719b3c94d591b5. 2023-07-18 04:11:42,686 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 76f52aff44f0f1bc8e719b3c94d591b5: 2023-07-18 04:11:42,686 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653502618.069615b68f58945552baff6ee8b80812.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:11:42,686 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 069615b68f58945552baff6ee8b80812, disabling compactions & flushes 2023-07-18 04:11:42,686 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653502618.069615b68f58945552baff6ee8b80812. 2023-07-18 04:11:42,686 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653502618.069615b68f58945552baff6ee8b80812. 2023-07-18 04:11:42,686 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653502618.069615b68f58945552baff6ee8b80812. after waiting 0 ms 2023-07-18 04:11:42,686 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653502618.069615b68f58945552baff6ee8b80812. 2023-07-18 04:11:42,686 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653502618.069615b68f58945552baff6ee8b80812. 2023-07-18 04:11:42,686 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 069615b68f58945552baff6ee8b80812: 2023-07-18 04:11:42,689 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 04:11:42,690 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502618.76f52aff44f0f1bc8e719b3c94d591b5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689653502690"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653502690"}]},"ts":"1689653502690"} 2023-07-18 04:11:42,690 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653502618.069615b68f58945552baff6ee8b80812.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689653502690"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653502690"}]},"ts":"1689653502690"} 2023-07-18 04:11:42,692 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 04:11:42,700 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 04:11:42,700 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653502700"}]},"ts":"1689653502700"} 2023-07-18 04:11:42,701 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-18 04:11:42,706 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 04:11:42,707 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 04:11:42,708 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 04:11:42,708 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 04:11:42,708 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 04:11:42,708 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=76f52aff44f0f1bc8e719b3c94d591b5, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=069615b68f58945552baff6ee8b80812, ASSIGN}] 2023-07-18 04:11:42,711 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=069615b68f58945552baff6ee8b80812, ASSIGN 2023-07-18 04:11:42,711 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=76f52aff44f0f1bc8e719b3c94d591b5, ASSIGN 2023-07-18 04:11:42,713 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=069615b68f58945552baff6ee8b80812, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43385,1689653423267; forceNewPlan=false, retain=false 2023-07-18 04:11:42,713 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=76f52aff44f0f1bc8e719b3c94d591b5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42889,1689653423206; forceNewPlan=false, retain=false 2023-07-18 04:11:42,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-18 04:11:42,863 INFO [jenkins-hbase4:46231] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 04:11:42,867 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=069615b68f58945552baff6ee8b80812, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:42,867 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653502618.069615b68f58945552baff6ee8b80812.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689653502867"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653502867"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653502867"}]},"ts":"1689653502867"} 2023-07-18 04:11:42,867 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=76f52aff44f0f1bc8e719b3c94d591b5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:42,867 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502618.76f52aff44f0f1bc8e719b3c94d591b5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689653502867"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653502867"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653502867"}]},"ts":"1689653502867"} 2023-07-18 04:11:42,869 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 069615b68f58945552baff6ee8b80812, server=jenkins-hbase4.apache.org,43385,1689653423267}] 2023-07-18 04:11:42,871 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure 76f52aff44f0f1bc8e719b3c94d591b5, server=jenkins-hbase4.apache.org,42889,1689653423206}] 2023-07-18 04:11:42,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-18 04:11:43,027 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653502618.069615b68f58945552baff6ee8b80812. 2023-07-18 04:11:43,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 069615b68f58945552baff6ee8b80812, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653502618.069615b68f58945552baff6ee8b80812.', STARTKEY => '2', ENDKEY => ''} 2023-07-18 04:11:43,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653502618.069615b68f58945552baff6ee8b80812. service=AccessControlService 2023-07-18 04:11:43,028 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:11:43,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 069615b68f58945552baff6ee8b80812 2023-07-18 04:11:43,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653502618.069615b68f58945552baff6ee8b80812.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:11:43,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 069615b68f58945552baff6ee8b80812 2023-07-18 04:11:43,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 069615b68f58945552baff6ee8b80812 2023-07-18 04:11:43,029 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502618.76f52aff44f0f1bc8e719b3c94d591b5. 2023-07-18 04:11:43,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 76f52aff44f0f1bc8e719b3c94d591b5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502618.76f52aff44f0f1bc8e719b3c94d591b5.', STARTKEY => '', ENDKEY => '2'} 2023-07-18 04:11:43,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502618.76f52aff44f0f1bc8e719b3c94d591b5. service=AccessControlService 2023-07-18 04:11:43,030 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:11:43,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 76f52aff44f0f1bc8e719b3c94d591b5 2023-07-18 04:11:43,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502618.76f52aff44f0f1bc8e719b3c94d591b5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:11:43,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 76f52aff44f0f1bc8e719b3c94d591b5 2023-07-18 04:11:43,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 76f52aff44f0f1bc8e719b3c94d591b5 2023-07-18 04:11:43,042 INFO [StoreOpener-069615b68f58945552baff6ee8b80812-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 069615b68f58945552baff6ee8b80812 2023-07-18 04:11:43,043 INFO [StoreOpener-76f52aff44f0f1bc8e719b3c94d591b5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 76f52aff44f0f1bc8e719b3c94d591b5 2023-07-18 04:11:43,045 DEBUG [StoreOpener-069615b68f58945552baff6ee8b80812-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/069615b68f58945552baff6ee8b80812/cf 2023-07-18 04:11:43,045 DEBUG [StoreOpener-069615b68f58945552baff6ee8b80812-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/069615b68f58945552baff6ee8b80812/cf 2023-07-18 04:11:43,045 DEBUG [StoreOpener-76f52aff44f0f1bc8e719b3c94d591b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76f52aff44f0f1bc8e719b3c94d591b5/cf 2023-07-18 04:11:43,045 DEBUG [StoreOpener-76f52aff44f0f1bc8e719b3c94d591b5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76f52aff44f0f1bc8e719b3c94d591b5/cf 2023-07-18 04:11:43,046 INFO [StoreOpener-76f52aff44f0f1bc8e719b3c94d591b5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 76f52aff44f0f1bc8e719b3c94d591b5 columnFamilyName cf 2023-07-18 04:11:43,046 INFO [StoreOpener-069615b68f58945552baff6ee8b80812-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 069615b68f58945552baff6ee8b80812 columnFamilyName cf 2023-07-18 04:11:43,047 INFO [StoreOpener-76f52aff44f0f1bc8e719b3c94d591b5-1] regionserver.HStore(310): Store=76f52aff44f0f1bc8e719b3c94d591b5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:11:43,048 INFO [StoreOpener-069615b68f58945552baff6ee8b80812-1] regionserver.HStore(310): Store=069615b68f58945552baff6ee8b80812/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:11:43,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76f52aff44f0f1bc8e719b3c94d591b5 2023-07-18 04:11:43,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/069615b68f58945552baff6ee8b80812 2023-07-18 04:11:43,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76f52aff44f0f1bc8e719b3c94d591b5 2023-07-18 04:11:43,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/069615b68f58945552baff6ee8b80812 2023-07-18 04:11:43,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 069615b68f58945552baff6ee8b80812 2023-07-18 04:11:43,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 76f52aff44f0f1bc8e719b3c94d591b5 2023-07-18 04:11:43,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76f52aff44f0f1bc8e719b3c94d591b5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 04:11:43,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/069615b68f58945552baff6ee8b80812/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 04:11:43,059 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 76f52aff44f0f1bc8e719b3c94d591b5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64433952, jitterRate=-0.03985929489135742}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 04:11:43,059 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 069615b68f58945552baff6ee8b80812; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66462600, jitterRate=-0.009630084037780762}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 04:11:43,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 76f52aff44f0f1bc8e719b3c94d591b5: 2023-07-18 04:11:43,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 069615b68f58945552baff6ee8b80812: 2023-07-18 04:11:43,060 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502618.76f52aff44f0f1bc8e719b3c94d591b5., pid=70, masterSystemTime=1689653503027 2023-07-18 04:11:43,060 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653502618.069615b68f58945552baff6ee8b80812., pid=69, masterSystemTime=1689653503023 2023-07-18 04:11:43,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502618.76f52aff44f0f1bc8e719b3c94d591b5. 2023-07-18 04:11:43,062 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502618.76f52aff44f0f1bc8e719b3c94d591b5. 2023-07-18 04:11:43,063 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=76f52aff44f0f1bc8e719b3c94d591b5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:43,063 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502618.76f52aff44f0f1bc8e719b3c94d591b5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689653503062"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689653503062"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689653503062"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689653503062"}]},"ts":"1689653503062"} 2023-07-18 04:11:43,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653502618.069615b68f58945552baff6ee8b80812. 2023-07-18 04:11:43,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653502618.069615b68f58945552baff6ee8b80812. 2023-07-18 04:11:43,064 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=069615b68f58945552baff6ee8b80812, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:43,065 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653502618.069615b68f58945552baff6ee8b80812.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689653503064"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689653503064"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689653503064"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689653503064"}]},"ts":"1689653503064"} 2023-07-18 04:11:43,069 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-18 04:11:43,069 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure 76f52aff44f0f1bc8e719b3c94d591b5, server=jenkins-hbase4.apache.org,42889,1689653423206 in 194 msec 2023-07-18 04:11:43,070 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-18 04:11:43,071 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 069615b68f58945552baff6ee8b80812, server=jenkins-hbase4.apache.org,43385,1689653423267 in 198 msec 2023-07-18 04:11:43,071 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=76f52aff44f0f1bc8e719b3c94d591b5, ASSIGN in 361 msec 2023-07-18 04:11:43,073 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-18 04:11:43,073 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=069615b68f58945552baff6ee8b80812, ASSIGN in 363 msec 2023-07-18 04:11:43,074 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 04:11:43,074 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653503074"}]},"ts":"1689653503074"} 2023-07-18 04:11:43,076 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-18 04:11:43,078 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 04:11:43,079 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-18 04:11:43,081 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35525] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-18 04:11:43,082 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:43,082 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:43,082 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:43,085 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 04:11:43,085 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 04:11:43,086 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-18 04:11:43,086 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-18 04:11:43,086 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 04:11:43,086 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-18 04:11:43,087 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:43,088 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 04:11:43,088 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-18 04:11:43,090 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 467 msec 2023-07-18 04:11:43,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-18 04:11:43,234 INFO [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-18 04:11:43,262 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 76f52aff44f0f1bc8e719b3c94d591b5, 069615b68f58945552baff6ee8b80812 2023-07-18 04:11:43,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[76f52aff44f0f1bc8e719b3c94d591b5, 069615b68f58945552baff6ee8b80812], force=true 2023-07-18 04:11:43,276 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[76f52aff44f0f1bc8e719b3c94d591b5, 069615b68f58945552baff6ee8b80812], force=true 2023-07-18 04:11:43,276 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[76f52aff44f0f1bc8e719b3c94d591b5, 069615b68f58945552baff6ee8b80812], force=true 2023-07-18 04:11:43,276 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[76f52aff44f0f1bc8e719b3c94d591b5, 069615b68f58945552baff6ee8b80812], force=true 2023-07-18 04:11:43,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-18 04:11:43,304 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=76f52aff44f0f1bc8e719b3c94d591b5, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=069615b68f58945552baff6ee8b80812, UNASSIGN}] 2023-07-18 04:11:43,307 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=069615b68f58945552baff6ee8b80812, UNASSIGN 2023-07-18 04:11:43,307 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=76f52aff44f0f1bc8e719b3c94d591b5, UNASSIGN 2023-07-18 04:11:43,308 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=069615b68f58945552baff6ee8b80812, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:43,308 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=76f52aff44f0f1bc8e719b3c94d591b5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:43,308 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653502618.069615b68f58945552baff6ee8b80812.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689653503308"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653503308"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653503308"}]},"ts":"1689653503308"} 2023-07-18 04:11:43,308 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502618.76f52aff44f0f1bc8e719b3c94d591b5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689653503308"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653503308"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653503308"}]},"ts":"1689653503308"} 2023-07-18 04:11:43,309 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 069615b68f58945552baff6ee8b80812, server=jenkins-hbase4.apache.org,43385,1689653423267}] 2023-07-18 04:11:43,310 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure 76f52aff44f0f1bc8e719b3c94d591b5, server=jenkins-hbase4.apache.org,42889,1689653423206}] 2023-07-18 04:11:43,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-18 04:11:43,462 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 069615b68f58945552baff6ee8b80812 2023-07-18 04:11:43,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 069615b68f58945552baff6ee8b80812, disabling compactions & flushes 2023-07-18 04:11:43,464 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653502618.069615b68f58945552baff6ee8b80812. 2023-07-18 04:11:43,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653502618.069615b68f58945552baff6ee8b80812. 2023-07-18 04:11:43,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653502618.069615b68f58945552baff6ee8b80812. after waiting 0 ms 2023-07-18 04:11:43,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653502618.069615b68f58945552baff6ee8b80812. 2023-07-18 04:11:43,465 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 069615b68f58945552baff6ee8b80812 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-18 04:11:43,465 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 76f52aff44f0f1bc8e719b3c94d591b5 2023-07-18 04:11:43,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 76f52aff44f0f1bc8e719b3c94d591b5, disabling compactions & flushes 2023-07-18 04:11:43,471 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502618.76f52aff44f0f1bc8e719b3c94d591b5. 2023-07-18 04:11:43,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502618.76f52aff44f0f1bc8e719b3c94d591b5. 2023-07-18 04:11:43,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502618.76f52aff44f0f1bc8e719b3c94d591b5. after waiting 0 ms 2023-07-18 04:11:43,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502618.76f52aff44f0f1bc8e719b3c94d591b5. 2023-07-18 04:11:43,471 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 76f52aff44f0f1bc8e719b3c94d591b5 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-18 04:11:43,563 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/069615b68f58945552baff6ee8b80812/.tmp/cf/37ed9b6e08814626b28c90c3d9131b5a 2023-07-18 04:11:43,565 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-18 04:11:43,576 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/069615b68f58945552baff6ee8b80812/.tmp/cf/37ed9b6e08814626b28c90c3d9131b5a as hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/069615b68f58945552baff6ee8b80812/cf/37ed9b6e08814626b28c90c3d9131b5a 2023-07-18 04:11:43,581 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/069615b68f58945552baff6ee8b80812/cf/37ed9b6e08814626b28c90c3d9131b5a, entries=1, sequenceid=5, filesize=4.7 K 2023-07-18 04:11:43,582 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 069615b68f58945552baff6ee8b80812 in 118ms, sequenceid=5, compaction requested=false 2023-07-18 04:11:43,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-18 04:11:43,600 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76f52aff44f0f1bc8e719b3c94d591b5/.tmp/cf/bedbc9e4c8744f8d9483247722c4e5ed 2023-07-18 04:11:43,611 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76f52aff44f0f1bc8e719b3c94d591b5/.tmp/cf/bedbc9e4c8744f8d9483247722c4e5ed as hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76f52aff44f0f1bc8e719b3c94d591b5/cf/bedbc9e4c8744f8d9483247722c4e5ed 2023-07-18 04:11:43,615 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/069615b68f58945552baff6ee8b80812/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-18 04:11:43,616 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:11:43,616 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653502618.069615b68f58945552baff6ee8b80812. 2023-07-18 04:11:43,616 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 069615b68f58945552baff6ee8b80812: 2023-07-18 04:11:43,617 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76f52aff44f0f1bc8e719b3c94d591b5/cf/bedbc9e4c8744f8d9483247722c4e5ed, entries=1, sequenceid=5, filesize=4.7 K 2023-07-18 04:11:43,618 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 76f52aff44f0f1bc8e719b3c94d591b5 in 147ms, sequenceid=5, compaction requested=false 2023-07-18 04:11:43,618 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 069615b68f58945552baff6ee8b80812 2023-07-18 04:11:43,618 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=069615b68f58945552baff6ee8b80812, regionState=CLOSED 2023-07-18 04:11:43,618 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653502618.069615b68f58945552baff6ee8b80812.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689653503618"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653503618"}]},"ts":"1689653503618"} 2023-07-18 04:11:43,621 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-18 04:11:43,621 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 069615b68f58945552baff6ee8b80812, server=jenkins-hbase4.apache.org,43385,1689653423267 in 311 msec 2023-07-18 04:11:43,622 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=069615b68f58945552baff6ee8b80812, UNASSIGN in 317 msec 2023-07-18 04:11:43,635 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76f52aff44f0f1bc8e719b3c94d591b5/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-18 04:11:43,636 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:11:43,636 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502618.76f52aff44f0f1bc8e719b3c94d591b5. 2023-07-18 04:11:43,636 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 76f52aff44f0f1bc8e719b3c94d591b5: 2023-07-18 04:11:43,637 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 76f52aff44f0f1bc8e719b3c94d591b5 2023-07-18 04:11:43,638 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=76f52aff44f0f1bc8e719b3c94d591b5, regionState=CLOSED 2023-07-18 04:11:43,638 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502618.76f52aff44f0f1bc8e719b3c94d591b5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689653503638"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653503638"}]},"ts":"1689653503638"} 2023-07-18 04:11:43,641 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-18 04:11:43,641 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure 76f52aff44f0f1bc8e719b3c94d591b5, server=jenkins-hbase4.apache.org,42889,1689653423206 in 329 msec 2023-07-18 04:11:43,643 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-18 04:11:43,643 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=76f52aff44f0f1bc8e719b3c94d591b5, UNASSIGN in 341 msec 2023-07-18 04:11:43,693 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/307effb8b28ceedf1ecfbfa2547bebdd/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-18 04:11:43,699 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502618.76f52aff44f0f1bc8e719b3c94d591b5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-18 04:11:43,699 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689653502618.069615b68f58945552baff6ee8b80812.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-18 04:11:43,699 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502619.307effb8b28ceedf1ecfbfa2547bebdd.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-18 04:11:43,759 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=307effb8b28ceedf1ecfbfa2547bebdd, ASSIGN}] 2023-07-18 04:11:43,760 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=307effb8b28ceedf1ecfbfa2547bebdd, ASSIGN 2023-07-18 04:11:43,761 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=307effb8b28ceedf1ecfbfa2547bebdd, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,42889,1689653423206; forceNewPlan=false, retain=false 2023-07-18 04:11:43,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-18 04:11:43,911 INFO [jenkins-hbase4:46231] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-18 04:11:43,913 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=307effb8b28ceedf1ecfbfa2547bebdd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:43,913 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502619.307effb8b28ceedf1ecfbfa2547bebdd.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689653503913"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653503913"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653503913"}]},"ts":"1689653503913"} 2023-07-18 04:11:43,920 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 307effb8b28ceedf1ecfbfa2547bebdd, server=jenkins-hbase4.apache.org,42889,1689653423206}] 2023-07-18 04:11:44,077 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502619.307effb8b28ceedf1ecfbfa2547bebdd. 2023-07-18 04:11:44,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 307effb8b28ceedf1ecfbfa2547bebdd, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502619.307effb8b28ceedf1ecfbfa2547bebdd.', STARTKEY => '', ENDKEY => ''} 2023-07-18 04:11:44,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502619.307effb8b28ceedf1ecfbfa2547bebdd. service=AccessControlService 2023-07-18 04:11:44,077 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:11:44,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 307effb8b28ceedf1ecfbfa2547bebdd 2023-07-18 04:11:44,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502619.307effb8b28ceedf1ecfbfa2547bebdd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:11:44,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 307effb8b28ceedf1ecfbfa2547bebdd 2023-07-18 04:11:44,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 307effb8b28ceedf1ecfbfa2547bebdd 2023-07-18 04:11:44,080 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/307effb8b28ceedf1ecfbfa2547bebdd/.regioninfo 2023-07-18 04:11:44,138 INFO [StoreOpener-307effb8b28ceedf1ecfbfa2547bebdd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 307effb8b28ceedf1ecfbfa2547bebdd 2023-07-18 04:11:44,141 DEBUG [StoreOpener-307effb8b28ceedf1ecfbfa2547bebdd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/307effb8b28ceedf1ecfbfa2547bebdd/cf 2023-07-18 04:11:44,141 DEBUG [StoreOpener-307effb8b28ceedf1ecfbfa2547bebdd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/307effb8b28ceedf1ecfbfa2547bebdd/cf 2023-07-18 04:11:44,142 INFO [StoreOpener-307effb8b28ceedf1ecfbfa2547bebdd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 307effb8b28ceedf1ecfbfa2547bebdd columnFamilyName cf 2023-07-18 04:11:44,166 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653430729_0004_000001 (auth:SIMPLE) 2023-07-18 04:11:44,188 DEBUG [StoreOpener-307effb8b28ceedf1ecfbfa2547bebdd-1] regionserver.HStore(539): loaded hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/307effb8b28ceedf1ecfbfa2547bebdd/cf/37ed9b6e08814626b28c90c3d9131b5a.069615b68f58945552baff6ee8b80812->hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/069615b68f58945552baff6ee8b80812/cf/37ed9b6e08814626b28c90c3d9131b5a-top 2023-07-18 04:11:44,205 DEBUG [StoreOpener-307effb8b28ceedf1ecfbfa2547bebdd-1] regionserver.HStore(539): loaded hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/307effb8b28ceedf1ecfbfa2547bebdd/cf/bedbc9e4c8744f8d9483247722c4e5ed.76f52aff44f0f1bc8e719b3c94d591b5->hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76f52aff44f0f1bc8e719b3c94d591b5/cf/bedbc9e4c8744f8d9483247722c4e5ed-top 2023-07-18 04:11:44,205 INFO [StoreOpener-307effb8b28ceedf1ecfbfa2547bebdd-1] regionserver.HStore(310): Store=307effb8b28ceedf1ecfbfa2547bebdd/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:11:44,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/307effb8b28ceedf1ecfbfa2547bebdd 2023-07-18 04:11:44,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/307effb8b28ceedf1ecfbfa2547bebdd 2023-07-18 04:11:44,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 307effb8b28ceedf1ecfbfa2547bebdd 2023-07-18 04:11:44,220 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 307effb8b28ceedf1ecfbfa2547bebdd; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60953178, jitterRate=-0.0917268693447113}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 04:11:44,220 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 307effb8b28ceedf1ecfbfa2547bebdd: 2023-07-18 04:11:44,223 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502619.307effb8b28ceedf1ecfbfa2547bebdd., pid=77, masterSystemTime=1689653504072 2023-07-18 04:11:44,224 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502619.307effb8b28ceedf1ecfbfa2547bebdd.,because compaction is disabled. 2023-07-18 04:11:44,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502619.307effb8b28ceedf1ecfbfa2547bebdd. 2023-07-18 04:11:44,226 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502619.307effb8b28ceedf1ecfbfa2547bebdd. 2023-07-18 04:11:44,226 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=307effb8b28ceedf1ecfbfa2547bebdd, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:44,227 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502619.307effb8b28ceedf1ecfbfa2547bebdd.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689653504226"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689653504226"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689653504226"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689653504226"}]},"ts":"1689653504226"} 2023-07-18 04:11:44,232 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-18 04:11:44,233 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 307effb8b28ceedf1ecfbfa2547bebdd, server=jenkins-hbase4.apache.org,42889,1689653423206 in 309 msec 2023-07-18 04:11:44,237 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-18 04:11:44,237 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=307effb8b28ceedf1ecfbfa2547bebdd, ASSIGN in 474 msec 2023-07-18 04:11:44,243 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[76f52aff44f0f1bc8e719b3c94d591b5, 069615b68f58945552baff6ee8b80812], force=true in 971 msec 2023-07-18 04:11:44,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-18 04:11:44,398 INFO [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-18 04:11:44,399 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-18 04:11:44,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689653504399 (current time:1689653504399). 2023-07-18 04:11:44,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 04:11:44,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(139): Connect 0x27189f52 to 127.0.0.1:64260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:11:44,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2eb8544b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:11:44,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:11:44,432 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35052, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:11:44,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x27189f52 to 127.0.0.1:64260 2023-07-18 04:11:44,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:11:44,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(139): Connect 0x412a4ad0 to 127.0.0.1:64260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:11:44,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22abbfa8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:11:44,455 DEBUG [hconnection-0x4e5dbdba-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:11:44,458 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35066, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:11:44,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:11:44,468 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40522, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:11:44,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x412a4ad0 to 127.0.0.1:64260 2023-07-18 04:11:44,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:11:44,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-18 04:11:44,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 04:11:44,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-18 04:11:44,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-18 04:11:44,485 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-18 04:11:44,486 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689654104486 2023-07-18 04:11:44,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-18 04:11:44,486 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,490 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 04:11:44,490 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 04:11:44,492 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-18 04:11:44,492 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-18 04:11:44,494 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 10 msec 2023-07-18 04:11:44,495 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-18 04:11:44,496 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689654104496 2023-07-18 04:11:44,510 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,510 INFO [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-18 04:11:44,510 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:11:44,512 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-18 04:11:44,512 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-18 04:11:44,516 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,516 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,517 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:44,517 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:44,518 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:44,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:44,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:44,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:44,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:44,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:44,518 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:44,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:44,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,518 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:44,519 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 04:11:44,519 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,519 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,519 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-18 04:11:44,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-18 04:11:44,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-18 04:11:44,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,520 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-18 04:11:44,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,519 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-18 04:11:44,520 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-18 04:11:44,520 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,520 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,520 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-18 04:11:44,520 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:11:44,520 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,520 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-18 04:11:44,520 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:11:44,520 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-18 04:11:44,527 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:11:44,524 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-18 04:11:44,527 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-18 04:11:44,527 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43385,1689653423267' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-18 04:11:44,528 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-18 04:11:44,528 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-18 04:11:44,528 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35525,1689653423141' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-18 04:11:44,525 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-18 04:11:44,530 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-18 04:11:44,530 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42889,1689653423206' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-18 04:11:44,530 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,531 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,531 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,531 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:11:44,531 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,531 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:11:44,533 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:44,533 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:44,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:44,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:44,533 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,533 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:11:44,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:44,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:44,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:44,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:44,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:44,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:44,537 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42889,1689653423206' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-18 04:11:44,537 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e70d957[Count = 0] remaining members to acquire global barrier 2023-07-18 04:11:44,537 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-18 04:11:44,537 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,538 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,538 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,538 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,538 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-18 04:11:44,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,539 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-18 04:11:44,539 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-18 04:11:44,539 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,43385,1689653423267' in zk 2023-07-18 04:11:44,539 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:44,539 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-18 04:11:44,539 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-18 04:11:44,539 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,35525,1689653423141' in zk 2023-07-18 04:11:44,539 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 04:11:44,541 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-18 04:11:44,541 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:11:44,541 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-18 04:11:44,541 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-18 04:11:44,541 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:11:44,541 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-18 04:11:44,554 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:11:44,554 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502619.307effb8b28ceedf1ecfbfa2547bebdd. 2023-07-18 04:11:44,554 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:11:44,555 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502619.307effb8b28ceedf1ecfbfa2547bebdd. started... 2023-07-18 04:11:44,556 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 307effb8b28ceedf1ecfbfa2547bebdd: 2023-07-18 04:11:44,556 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502619.307effb8b28ceedf1ecfbfa2547bebdd.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,556 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:11:44,557 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/307effb8b28ceedf1ecfbfa2547bebdd/cf/37ed9b6e08814626b28c90c3d9131b5a.069615b68f58945552baff6ee8b80812->hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/069615b68f58945552baff6ee8b80812/cf/37ed9b6e08814626b28c90c3d9131b5a-top, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/307effb8b28ceedf1ecfbfa2547bebdd/cf/bedbc9e4c8744f8d9483247722c4e5ed.76f52aff44f0f1bc8e719b3c94d591b5->hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76f52aff44f0f1bc8e719b3c94d591b5/cf/bedbc9e4c8744f8d9483247722c4e5ed-top] hfiles 2023-07-18 04:11:44,557 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/307effb8b28ceedf1ecfbfa2547bebdd/cf/37ed9b6e08814626b28c90c3d9131b5a.069615b68f58945552baff6ee8b80812 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,557 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/307effb8b28ceedf1ecfbfa2547bebdd/cf/bedbc9e4c8744f8d9483247722c4e5ed.76f52aff44f0f1bc8e719b3c94d591b5 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,579 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502619.307effb8b28ceedf1ecfbfa2547bebdd. completed. 2023-07-18 04:11:44,579 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502619.307effb8b28ceedf1ecfbfa2547bebdd. 2023-07-18 04:11:44,579 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:11:44,579 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:11:44,580 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:44,580 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-18 04:11:44,580 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,42889,1689653423206' in zk 2023-07-18 04:11:44,584 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-18 04:11:44,584 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:44,584 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:11:44,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:44,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:44,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:44,584 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-18 04:11:44,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:44,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:44,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:44,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:44,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:44,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:44,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:44,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:44,591 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:11:44,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-18 04:11:44,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:11:44,592 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 04:11:44,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:44,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,42889,1689653423206': 2023-07-18 04:11:44,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42889,1689653423206' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-18 04:11:44,597 INFO [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-18 04:11:44,597 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 04:11:44,597 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 04:11:44,597 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,597 INFO [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 04:11:44,599 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,599 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:44,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,599 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,600 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:44,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:44,599 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,600 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:44,600 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:44,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:44,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:44,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:44,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:44,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:44,601 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:44,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,601 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:44,602 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:11:44,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:11:44,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:11:44,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,603 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:44,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:11:44,604 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:44,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,604 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:44,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:44,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:44,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:44,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:11:44,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:44,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:44,613 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:44,613 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:44,613 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:44,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:44,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:44,613 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:11:44,613 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:44,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:44,613 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:44,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:11:44,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:44,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:44,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:44,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:11:44,613 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,614 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,613 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,613 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:11:44,613 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:11:44,614 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:44,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:44,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:44,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:11:44,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:44,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:11:44,614 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:44,615 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,615 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 because node does not exist (not an error) 2023-07-18 04:11:44,615 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:44,615 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,615 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:11:44,615 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:44,615 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,615 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,616 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,669 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,734 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-18 04:11:44,734 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,735 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,735 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689653504486Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689653504614 (+128 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689653504614Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689653504624 (+10 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689653504641 (+17 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689653504734 (+93 ms) 2023-07-18 04:11:44,738 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-18 04:11:44,739 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 248 msec 2023-07-18 04:11:44,792 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:11:44,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-18 04:11:44,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 04:11:44,794 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653504794 2023-07-18 04:11:44,794 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43229, tgtDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653504794, rawTgtDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653504794, srcFsUri=hdfs://localhost:43229, srcDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8 2023-07-18 04:11:44,828 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43229, inputRoot=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8 2023-07-18 04:11:44,828 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1973476679_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653504794, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653504794/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:44,828 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43229, inputRoot=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8, snapshotDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-18 04:11:44,843 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653504794/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:45,292 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:45,292 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:45,293 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:45,293 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:45,294 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:45,294 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:45,295 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:45,390 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/hadoop-441591270388839780.jar 2023-07-18 04:11:45,391 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:45,391 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:45,392 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:45,392 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:45,393 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:45,393 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 04:11:45,394 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 04:11:45,395 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 04:11:45,395 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 04:11:45,396 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 04:11:45,396 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 04:11:45,397 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 04:11:45,398 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 04:11:45,398 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 04:11:45,399 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 04:11:45,399 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 04:11:45,400 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:11:45,400 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:11:45,401 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 04:11:45,401 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:11:45,402 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:11:45,402 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 04:11:45,403 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 04:11:45,733 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 04:11:46,071 WARN [Listener at jenkins-hbase4.apache.org/40435] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 04:11:46,073 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-18 04:11:46,075 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-18 04:11:46,141 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 04:11:46,142 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 04:11:46,152 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653430729_0005_000001 (auth:SIMPLE) 2023-07-18 04:11:51,890 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653430729_0005_000001 (auth:SIMPLE) 2023-07-18 04:11:54,266 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653430729_0005_000001 (auth:SIMPLE) 2023-07-18 04:11:58,189 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653430729_0005_000001 (auth:SIMPLE) 2023-07-18 04:11:59,344 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 04:11:59,345 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 04:11:59,358 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:59,358 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 04:11:59,359 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 04:11:59,359 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-559505343_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:59,360 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(367): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-18 04:11:59,360 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(367): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-18 04:11:59,360 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-559505343_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653504794/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653504794/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:59,361 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(367): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653504794/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-18 04:11:59,361 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(367): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653504794/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-18 04:11:59,368 INFO [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:59,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:59,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:59,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-18 04:11:59,382 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653519381"}]},"ts":"1689653519381"} 2023-07-18 04:11:59,384 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-18 04:11:59,386 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-18 04:11:59,386 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=307effb8b28ceedf1ecfbfa2547bebdd, UNASSIGN}] 2023-07-18 04:11:59,387 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=307effb8b28ceedf1ecfbfa2547bebdd, UNASSIGN 2023-07-18 04:11:59,388 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=307effb8b28ceedf1ecfbfa2547bebdd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:59,388 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502619.307effb8b28ceedf1ecfbfa2547bebdd.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689653519388"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653519388"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653519388"}]},"ts":"1689653519388"} 2023-07-18 04:11:59,392 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 307effb8b28ceedf1ecfbfa2547bebdd, server=jenkins-hbase4.apache.org,42889,1689653423206}] 2023-07-18 04:11:59,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-18 04:11:59,544 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 307effb8b28ceedf1ecfbfa2547bebdd 2023-07-18 04:11:59,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 307effb8b28ceedf1ecfbfa2547bebdd, disabling compactions & flushes 2023-07-18 04:11:59,544 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502619.307effb8b28ceedf1ecfbfa2547bebdd. 2023-07-18 04:11:59,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502619.307effb8b28ceedf1ecfbfa2547bebdd. 2023-07-18 04:11:59,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502619.307effb8b28ceedf1ecfbfa2547bebdd. after waiting 0 ms 2023-07-18 04:11:59,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502619.307effb8b28ceedf1ecfbfa2547bebdd. 2023-07-18 04:11:59,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/307effb8b28ceedf1ecfbfa2547bebdd/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-18 04:11:59,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:11:59,559 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502619.307effb8b28ceedf1ecfbfa2547bebdd. 2023-07-18 04:11:59,559 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 307effb8b28ceedf1ecfbfa2547bebdd: 2023-07-18 04:11:59,563 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 307effb8b28ceedf1ecfbfa2547bebdd 2023-07-18 04:11:59,563 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=307effb8b28ceedf1ecfbfa2547bebdd, regionState=CLOSED 2023-07-18 04:11:59,564 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502619.307effb8b28ceedf1ecfbfa2547bebdd.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689653519563"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653519563"}]},"ts":"1689653519563"} 2023-07-18 04:11:59,567 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-18 04:11:59,567 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 307effb8b28ceedf1ecfbfa2547bebdd, server=jenkins-hbase4.apache.org,42889,1689653423206 in 174 msec 2023-07-18 04:11:59,568 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-18 04:11:59,568 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=307effb8b28ceedf1ecfbfa2547bebdd, UNASSIGN in 181 msec 2023-07-18 04:11:59,569 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653519569"}]},"ts":"1689653519569"} 2023-07-18 04:11:59,570 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-18 04:11:59,572 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-18 04:11:59,575 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 205 msec 2023-07-18 04:11:59,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-18 04:11:59,681 INFO [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-18 04:11:59,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:59,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:59,687 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:59,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:59,690 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:59,690 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35525] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:59,693 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:59,693 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:59,693 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:59,693 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:59,694 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-18 04:11:59,694 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-18 04:11:59,696 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/307effb8b28ceedf1ecfbfa2547bebdd 2023-07-18 04:11:59,697 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/069615b68f58945552baff6ee8b80812 2023-07-18 04:11:59,697 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76f52aff44f0f1bc8e719b3c94d591b5 2023-07-18 04:11:59,699 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/307effb8b28ceedf1ecfbfa2547bebdd/cf, FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/307effb8b28ceedf1ecfbfa2547bebdd/recovered.edits] 2023-07-18 04:11:59,700 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-18 04:11:59,700 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-18 04:11:59,702 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:59,702 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:59,702 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:59,702 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:59,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-18 04:11:59,703 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:59,704 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:59,704 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:59,704 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:11:59,704 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 04:11:59,704 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 04:11:59,705 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 04:11:59,705 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 04:11:59,708 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/069615b68f58945552baff6ee8b80812/cf, FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/069615b68f58945552baff6ee8b80812/recovered.edits] 2023-07-18 04:11:59,708 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76f52aff44f0f1bc8e719b3c94d591b5/cf, FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76f52aff44f0f1bc8e719b3c94d591b5/recovered.edits] 2023-07-18 04:11:59,721 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/307effb8b28ceedf1ecfbfa2547bebdd/cf/37ed9b6e08814626b28c90c3d9131b5a.069615b68f58945552baff6ee8b80812 to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/307effb8b28ceedf1ecfbfa2547bebdd/cf/37ed9b6e08814626b28c90c3d9131b5a.069615b68f58945552baff6ee8b80812 2023-07-18 04:11:59,724 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/307effb8b28ceedf1ecfbfa2547bebdd/cf/bedbc9e4c8744f8d9483247722c4e5ed.76f52aff44f0f1bc8e719b3c94d591b5 to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/307effb8b28ceedf1ecfbfa2547bebdd/cf/bedbc9e4c8744f8d9483247722c4e5ed.76f52aff44f0f1bc8e719b3c94d591b5 2023-07-18 04:11:59,725 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/069615b68f58945552baff6ee8b80812/cf/37ed9b6e08814626b28c90c3d9131b5a to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/069615b68f58945552baff6ee8b80812/cf/37ed9b6e08814626b28c90c3d9131b5a 2023-07-18 04:11:59,731 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76f52aff44f0f1bc8e719b3c94d591b5/cf/bedbc9e4c8744f8d9483247722c4e5ed to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76f52aff44f0f1bc8e719b3c94d591b5/cf/bedbc9e4c8744f8d9483247722c4e5ed 2023-07-18 04:11:59,732 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/069615b68f58945552baff6ee8b80812/recovered.edits/8.seqid to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/069615b68f58945552baff6ee8b80812/recovered.edits/8.seqid 2023-07-18 04:11:59,733 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/069615b68f58945552baff6ee8b80812 2023-07-18 04:11:59,733 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/307effb8b28ceedf1ecfbfa2547bebdd/recovered.edits/12.seqid to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/307effb8b28ceedf1ecfbfa2547bebdd/recovered.edits/12.seqid 2023-07-18 04:11:59,734 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/307effb8b28ceedf1ecfbfa2547bebdd 2023-07-18 04:11:59,737 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76f52aff44f0f1bc8e719b3c94d591b5/recovered.edits/8.seqid to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76f52aff44f0f1bc8e719b3c94d591b5/recovered.edits/8.seqid 2023-07-18 04:11:59,738 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/76f52aff44f0f1bc8e719b3c94d591b5 2023-07-18 04:11:59,738 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-18 04:11:59,746 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:59,754 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-18 04:11:59,761 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-18 04:11:59,762 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:59,763 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-18 04:11:59,763 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502619.307effb8b28ceedf1ecfbfa2547bebdd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689653519763"}]},"ts":"9223372036854775807"} 2023-07-18 04:11:59,778 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-18 04:11:59,778 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 307effb8b28ceedf1ecfbfa2547bebdd, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689653502619.307effb8b28ceedf1ecfbfa2547bebdd.', STARTKEY => '', ENDKEY => ''}] 2023-07-18 04:11:59,778 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-18 04:11:59,778 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689653519778"}]},"ts":"9223372036854775807"} 2023-07-18 04:11:59,783 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-18 04:11:59,786 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:11:59,788 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 103 msec 2023-07-18 04:11:59,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-18 04:11:59,805 INFO [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-18 04:11:59,805 INFO [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:59,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:59,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:11:59,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-18 04:11:59,811 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653519811"}]},"ts":"1689653519811"} 2023-07-18 04:11:59,813 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-18 04:11:59,815 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-18 04:11:59,816 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6f14c4f673923b3da2f3c0a3a4cdc0b7, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0a9fcef8d4f90f1741eaf59bc0524756, UNASSIGN}] 2023-07-18 04:11:59,818 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6f14c4f673923b3da2f3c0a3a4cdc0b7, UNASSIGN 2023-07-18 04:11:59,818 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0a9fcef8d4f90f1741eaf59bc0524756, UNASSIGN 2023-07-18 04:11:59,823 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=0a9fcef8d4f90f1741eaf59bc0524756, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:11:59,823 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=6f14c4f673923b3da2f3c0a3a4cdc0b7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:11:59,823 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689653500441.0a9fcef8d4f90f1741eaf59bc0524756.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689653519823"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653519823"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653519823"}]},"ts":"1689653519823"} 2023-07-18 04:11:59,823 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689653500441.6f14c4f673923b3da2f3c0a3a4cdc0b7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689653519823"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653519823"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653519823"}]},"ts":"1689653519823"} 2023-07-18 04:11:59,825 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure 0a9fcef8d4f90f1741eaf59bc0524756, server=jenkins-hbase4.apache.org,43385,1689653423267}] 2023-07-18 04:11:59,825 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure 6f14c4f673923b3da2f3c0a3a4cdc0b7, server=jenkins-hbase4.apache.org,42889,1689653423206}] 2023-07-18 04:11:59,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-18 04:11:59,978 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6f14c4f673923b3da2f3c0a3a4cdc0b7 2023-07-18 04:11:59,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6f14c4f673923b3da2f3c0a3a4cdc0b7, disabling compactions & flushes 2023-07-18 04:11:59,979 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689653500441.6f14c4f673923b3da2f3c0a3a4cdc0b7. 2023-07-18 04:11:59,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689653500441.6f14c4f673923b3da2f3c0a3a4cdc0b7. 2023-07-18 04:11:59,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689653500441.6f14c4f673923b3da2f3c0a3a4cdc0b7. after waiting 0 ms 2023-07-18 04:11:59,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689653500441.6f14c4f673923b3da2f3c0a3a4cdc0b7. 2023-07-18 04:11:59,979 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0a9fcef8d4f90f1741eaf59bc0524756 2023-07-18 04:11:59,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0a9fcef8d4f90f1741eaf59bc0524756, disabling compactions & flushes 2023-07-18 04:11:59,979 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689653500441.0a9fcef8d4f90f1741eaf59bc0524756. 2023-07-18 04:11:59,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689653500441.0a9fcef8d4f90f1741eaf59bc0524756. 2023-07-18 04:11:59,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689653500441.0a9fcef8d4f90f1741eaf59bc0524756. after waiting 0 ms 2023-07-18 04:11:59,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689653500441.0a9fcef8d4f90f1741eaf59bc0524756. 2023-07-18 04:12:00,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f14c4f673923b3da2f3c0a3a4cdc0b7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 04:12:00,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a9fcef8d4f90f1741eaf59bc0524756/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 04:12:00,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:12:00,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:12:00,051 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689653500441.0a9fcef8d4f90f1741eaf59bc0524756. 2023-07-18 04:12:00,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0a9fcef8d4f90f1741eaf59bc0524756: 2023-07-18 04:12:00,052 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689653500441.6f14c4f673923b3da2f3c0a3a4cdc0b7. 2023-07-18 04:12:00,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6f14c4f673923b3da2f3c0a3a4cdc0b7: 2023-07-18 04:12:00,056 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0a9fcef8d4f90f1741eaf59bc0524756 2023-07-18 04:12:00,057 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=0a9fcef8d4f90f1741eaf59bc0524756, regionState=CLOSED 2023-07-18 04:12:00,057 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689653500441.0a9fcef8d4f90f1741eaf59bc0524756.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689653520056"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653520056"}]},"ts":"1689653520056"} 2023-07-18 04:12:00,057 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6f14c4f673923b3da2f3c0a3a4cdc0b7 2023-07-18 04:12:00,064 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=6f14c4f673923b3da2f3c0a3a4cdc0b7, regionState=CLOSED 2023-07-18 04:12:00,064 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689653500441.6f14c4f673923b3da2f3c0a3a4cdc0b7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689653520064"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653520064"}]},"ts":"1689653520064"} 2023-07-18 04:12:00,067 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-18 04:12:00,067 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure 0a9fcef8d4f90f1741eaf59bc0524756, server=jenkins-hbase4.apache.org,43385,1689653423267 in 239 msec 2023-07-18 04:12:00,073 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0a9fcef8d4f90f1741eaf59bc0524756, UNASSIGN in 251 msec 2023-07-18 04:12:00,073 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-18 04:12:00,074 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure 6f14c4f673923b3da2f3c0a3a4cdc0b7, server=jenkins-hbase4.apache.org,42889,1689653423206 in 241 msec 2023-07-18 04:12:00,076 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-18 04:12:00,076 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6f14c4f673923b3da2f3c0a3a4cdc0b7, UNASSIGN in 257 msec 2023-07-18 04:12:00,078 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653520078"}]},"ts":"1689653520078"} 2023-07-18 04:12:00,080 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-18 04:12:00,091 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-18 04:12:00,093 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 286 msec 2023-07-18 04:12:00,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-18 04:12:00,114 INFO [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-18 04:12:00,116 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:12:00,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:12:00,120 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:12:00,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:12:00,123 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:12:00,128 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35525] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:12:00,130 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f14c4f673923b3da2f3c0a3a4cdc0b7 2023-07-18 04:12:00,130 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a9fcef8d4f90f1741eaf59bc0524756 2023-07-18 04:12:00,131 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:12:00,131 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:12:00,132 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:12:00,132 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:12:00,132 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-18 04:12:00,132 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-18 04:12:00,133 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:00,133 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-18 04:12:00,133 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:00,133 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:12:00,133 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-18 04:12:00,133 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:12:00,133 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-18 04:12:00,133 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-18 04:12:00,133 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:00,133 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:00,134 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f14c4f673923b3da2f3c0a3a4cdc0b7/cf, FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f14c4f673923b3da2f3c0a3a4cdc0b7/recovered.edits] 2023-07-18 04:12:00,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-18 04:12:00,135 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a9fcef8d4f90f1741eaf59bc0524756/cf, FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a9fcef8d4f90f1741eaf59bc0524756/recovered.edits] 2023-07-18 04:12:00,141 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f14c4f673923b3da2f3c0a3a4cdc0b7/cf/206801f0ea724235a9517ffab00cdda4 to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f14c4f673923b3da2f3c0a3a4cdc0b7/cf/206801f0ea724235a9517ffab00cdda4 2023-07-18 04:12:00,142 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a9fcef8d4f90f1741eaf59bc0524756/cf/6368b16d83c749978349190229173507 to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a9fcef8d4f90f1741eaf59bc0524756/cf/6368b16d83c749978349190229173507 2023-07-18 04:12:00,148 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a9fcef8d4f90f1741eaf59bc0524756/recovered.edits/9.seqid to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a9fcef8d4f90f1741eaf59bc0524756/recovered.edits/9.seqid 2023-07-18 04:12:00,149 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f14c4f673923b3da2f3c0a3a4cdc0b7/recovered.edits/9.seqid to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f14c4f673923b3da2f3c0a3a4cdc0b7/recovered.edits/9.seqid 2023-07-18 04:12:00,149 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0a9fcef8d4f90f1741eaf59bc0524756 2023-07-18 04:12:00,150 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6f14c4f673923b3da2f3c0a3a4cdc0b7 2023-07-18 04:12:00,150 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-18 04:12:00,150 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-18 04:12:00,151 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-18 04:12:00,156 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023071895f3c9560cd54c0e8e675f8e7e275276 to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023071895f3c9560cd54c0e8e675f8e7e275276 2023-07-18 04:12:00,158 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230718017d8584b9cd4ef89d8ffe9068e6a2c9 to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230718017d8584b9cd4ef89d8ffe9068e6a2c9 2023-07-18 04:12:00,159 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-18 04:12:00,162 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:12:00,192 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-18 04:12:00,208 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-18 04:12:00,209 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:12:00,209 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-18 04:12:00,209 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689653500441.6f14c4f673923b3da2f3c0a3a4cdc0b7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689653520209"}]},"ts":"9223372036854775807"} 2023-07-18 04:12:00,210 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689653500441.0a9fcef8d4f90f1741eaf59bc0524756.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689653520209"}]},"ts":"9223372036854775807"} 2023-07-18 04:12:00,212 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-18 04:12:00,212 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6f14c4f673923b3da2f3c0a3a4cdc0b7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689653500441.6f14c4f673923b3da2f3c0a3a4cdc0b7.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0a9fcef8d4f90f1741eaf59bc0524756, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689653500441.0a9fcef8d4f90f1741eaf59bc0524756.', STARTKEY => '1', ENDKEY => ''}] 2023-07-18 04:12:00,212 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-18 04:12:00,213 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689653520213"}]},"ts":"9223372036854775807"} 2023-07-18 04:12:00,215 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-18 04:12:00,217 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 04:12:00,219 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 101 msec 2023-07-18 04:12:00,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-18 04:12:00,236 INFO [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-18 04:12:00,270 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-18 04:12:00,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:12:00,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-18 04:12:00,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 04:12:00,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-18 04:12:00,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 04:12:00,340 INFO [Listener at jenkins-hbase4.apache.org/40435] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=759 (was 743) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4334 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0xf2856f0-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xf2856f0-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1343642557_1 at /127.0.0.1:59260 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xf2856f0-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xf2856f0-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-559505343_17 at /127.0.0.1:34836 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xf2856f0-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-559505343_17 at /127.0.0.1:58918 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1343642557_1 at /127.0.0.1:34818 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1966361669) connection to jenkins-hbase4.apache.org/172.31.14.131:37135 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-559505343_17 at /127.0.0.1:59278 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xf2856f0-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=906 (was 909), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=373 (was 384), ProcessCount=186 (was 183) - ProcessCount LEAK? -, AvailableMemoryMB=2829 (was 3295) 2023-07-18 04:12:00,341 WARN [Listener at jenkins-hbase4.apache.org/40435] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-18 04:12:00,387 INFO [Listener at jenkins-hbase4.apache.org/40435] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=759, OpenFileDescriptor=906, MaxFileDescriptor=60000, SystemLoadAverage=373, ProcessCount=186, AvailableMemoryMB=2821 2023-07-18 04:12:00,387 WARN [Listener at jenkins-hbase4.apache.org/40435] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-18 04:12:00,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-18 04:12:00,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 04:12:00,399 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 04:12:00,400 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 04:12:00,401 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-18 04:12:00,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-18 04:12:00,405 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testEmptyExportFileSystemState/305be54eb73d3d4cd32347162eb60256 2023-07-18 04:12:00,405 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testEmptyExportFileSystemState/b6cc8d8d3c819e9b2a7b7daa4a67f78b 2023-07-18 04:12:00,406 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testEmptyExportFileSystemState/b6cc8d8d3c819e9b2a7b7daa4a67f78b empty. 2023-07-18 04:12:00,406 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testEmptyExportFileSystemState/305be54eb73d3d4cd32347162eb60256 empty. 2023-07-18 04:12:00,406 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testEmptyExportFileSystemState/b6cc8d8d3c819e9b2a7b7daa4a67f78b 2023-07-18 04:12:00,407 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testEmptyExportFileSystemState/305be54eb73d3d4cd32347162eb60256 2023-07-18 04:12:00,407 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-18 04:12:00,495 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-18 04:12:00,499 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 305be54eb73d3d4cd32347162eb60256, NAME => 'testtb-testEmptyExportFileSystemState,1,1689653520389.305be54eb73d3d4cd32347162eb60256.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp 2023-07-18 04:12:00,499 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => b6cc8d8d3c819e9b2a7b7daa4a67f78b, NAME => 'testtb-testEmptyExportFileSystemState,,1689653520389.b6cc8d8d3c819e9b2a7b7daa4a67f78b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp 2023-07-18 04:12:00,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-18 04:12:00,580 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689653520389.305be54eb73d3d4cd32347162eb60256.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:12:00,580 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 305be54eb73d3d4cd32347162eb60256, disabling compactions & flushes 2023-07-18 04:12:00,580 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689653520389.305be54eb73d3d4cd32347162eb60256. 2023-07-18 04:12:00,580 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689653520389.305be54eb73d3d4cd32347162eb60256. 2023-07-18 04:12:00,580 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689653520389.305be54eb73d3d4cd32347162eb60256. after waiting 0 ms 2023-07-18 04:12:00,580 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689653520389.305be54eb73d3d4cd32347162eb60256. 2023-07-18 04:12:00,580 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689653520389.305be54eb73d3d4cd32347162eb60256. 2023-07-18 04:12:00,580 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 305be54eb73d3d4cd32347162eb60256: 2023-07-18 04:12:00,613 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689653520389.b6cc8d8d3c819e9b2a7b7daa4a67f78b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:12:00,613 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing b6cc8d8d3c819e9b2a7b7daa4a67f78b, disabling compactions & flushes 2023-07-18 04:12:00,613 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689653520389.b6cc8d8d3c819e9b2a7b7daa4a67f78b. 2023-07-18 04:12:00,613 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689653520389.b6cc8d8d3c819e9b2a7b7daa4a67f78b. 2023-07-18 04:12:00,613 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689653520389.b6cc8d8d3c819e9b2a7b7daa4a67f78b. after waiting 0 ms 2023-07-18 04:12:00,613 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689653520389.b6cc8d8d3c819e9b2a7b7daa4a67f78b. 2023-07-18 04:12:00,613 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689653520389.b6cc8d8d3c819e9b2a7b7daa4a67f78b. 2023-07-18 04:12:00,613 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for b6cc8d8d3c819e9b2a7b7daa4a67f78b: 2023-07-18 04:12:00,616 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 04:12:00,617 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689653520389.305be54eb73d3d4cd32347162eb60256.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689653520617"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653520617"}]},"ts":"1689653520617"} 2023-07-18 04:12:00,617 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689653520389.b6cc8d8d3c819e9b2a7b7daa4a67f78b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689653520617"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653520617"}]},"ts":"1689653520617"} 2023-07-18 04:12:00,627 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 04:12:00,628 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 04:12:00,628 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653520628"}]},"ts":"1689653520628"} 2023-07-18 04:12:00,631 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-18 04:12:00,636 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 04:12:00,638 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 04:12:00,638 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 04:12:00,638 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 04:12:00,638 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 04:12:00,638 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b6cc8d8d3c819e9b2a7b7daa4a67f78b, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=305be54eb73d3d4cd32347162eb60256, ASSIGN}] 2023-07-18 04:12:00,642 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b6cc8d8d3c819e9b2a7b7daa4a67f78b, ASSIGN 2023-07-18 04:12:00,642 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=305be54eb73d3d4cd32347162eb60256, ASSIGN 2023-07-18 04:12:00,643 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b6cc8d8d3c819e9b2a7b7daa4a67f78b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42889,1689653423206; forceNewPlan=false, retain=false 2023-07-18 04:12:00,644 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=305be54eb73d3d4cd32347162eb60256, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35525,1689653423141; forceNewPlan=false, retain=false 2023-07-18 04:12:00,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-18 04:12:00,793 INFO [jenkins-hbase4:46231] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 04:12:00,797 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=305be54eb73d3d4cd32347162eb60256, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:00,797 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689653520389.305be54eb73d3d4cd32347162eb60256.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689653520797"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653520797"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653520797"}]},"ts":"1689653520797"} 2023-07-18 04:12:00,797 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=b6cc8d8d3c819e9b2a7b7daa4a67f78b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:00,798 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689653520389.b6cc8d8d3c819e9b2a7b7daa4a67f78b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689653520797"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653520797"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653520797"}]},"ts":"1689653520797"} 2023-07-18 04:12:00,802 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 305be54eb73d3d4cd32347162eb60256, server=jenkins-hbase4.apache.org,35525,1689653423141}] 2023-07-18 04:12:00,803 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure b6cc8d8d3c819e9b2a7b7daa4a67f78b, server=jenkins-hbase4.apache.org,42889,1689653423206}] 2023-07-18 04:12:00,962 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689653520389.b6cc8d8d3c819e9b2a7b7daa4a67f78b. 2023-07-18 04:12:00,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b6cc8d8d3c819e9b2a7b7daa4a67f78b, NAME => 'testtb-testEmptyExportFileSystemState,,1689653520389.b6cc8d8d3c819e9b2a7b7daa4a67f78b.', STARTKEY => '', ENDKEY => '1'} 2023-07-18 04:12:00,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689653520389.b6cc8d8d3c819e9b2a7b7daa4a67f78b. service=AccessControlService 2023-07-18 04:12:00,962 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:12:00,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState b6cc8d8d3c819e9b2a7b7daa4a67f78b 2023-07-18 04:12:00,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689653520389.b6cc8d8d3c819e9b2a7b7daa4a67f78b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:12:00,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b6cc8d8d3c819e9b2a7b7daa4a67f78b 2023-07-18 04:12:00,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b6cc8d8d3c819e9b2a7b7daa4a67f78b 2023-07-18 04:12:00,967 INFO [StoreOpener-b6cc8d8d3c819e9b2a7b7daa4a67f78b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b6cc8d8d3c819e9b2a7b7daa4a67f78b 2023-07-18 04:12:00,969 DEBUG [StoreOpener-b6cc8d8d3c819e9b2a7b7daa4a67f78b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testEmptyExportFileSystemState/b6cc8d8d3c819e9b2a7b7daa4a67f78b/cf 2023-07-18 04:12:00,969 DEBUG [StoreOpener-b6cc8d8d3c819e9b2a7b7daa4a67f78b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testEmptyExportFileSystemState/b6cc8d8d3c819e9b2a7b7daa4a67f78b/cf 2023-07-18 04:12:00,970 INFO [StoreOpener-b6cc8d8d3c819e9b2a7b7daa4a67f78b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b6cc8d8d3c819e9b2a7b7daa4a67f78b columnFamilyName cf 2023-07-18 04:12:00,972 INFO [StoreOpener-b6cc8d8d3c819e9b2a7b7daa4a67f78b-1] regionserver.HStore(310): Store=b6cc8d8d3c819e9b2a7b7daa4a67f78b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:12:00,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testEmptyExportFileSystemState/b6cc8d8d3c819e9b2a7b7daa4a67f78b 2023-07-18 04:12:00,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testEmptyExportFileSystemState/b6cc8d8d3c819e9b2a7b7daa4a67f78b 2023-07-18 04:12:00,975 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689653520389.305be54eb73d3d4cd32347162eb60256. 2023-07-18 04:12:00,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 305be54eb73d3d4cd32347162eb60256, NAME => 'testtb-testEmptyExportFileSystemState,1,1689653520389.305be54eb73d3d4cd32347162eb60256.', STARTKEY => '1', ENDKEY => ''} 2023-07-18 04:12:00,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689653520389.305be54eb73d3d4cd32347162eb60256. service=AccessControlService 2023-07-18 04:12:00,976 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:12:00,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 305be54eb73d3d4cd32347162eb60256 2023-07-18 04:12:00,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689653520389.305be54eb73d3d4cd32347162eb60256.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:12:00,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 305be54eb73d3d4cd32347162eb60256 2023-07-18 04:12:00,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 305be54eb73d3d4cd32347162eb60256 2023-07-18 04:12:00,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b6cc8d8d3c819e9b2a7b7daa4a67f78b 2023-07-18 04:12:00,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testEmptyExportFileSystemState/b6cc8d8d3c819e9b2a7b7daa4a67f78b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 04:12:00,992 INFO [StoreOpener-305be54eb73d3d4cd32347162eb60256-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 305be54eb73d3d4cd32347162eb60256 2023-07-18 04:12:00,993 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b6cc8d8d3c819e9b2a7b7daa4a67f78b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58871515, jitterRate=-0.1227460652589798}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 04:12:00,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b6cc8d8d3c819e9b2a7b7daa4a67f78b: 2023-07-18 04:12:00,994 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689653520389.b6cc8d8d3c819e9b2a7b7daa4a67f78b., pid=94, masterSystemTime=1689653520955 2023-07-18 04:12:00,994 DEBUG [StoreOpener-305be54eb73d3d4cd32347162eb60256-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testEmptyExportFileSystemState/305be54eb73d3d4cd32347162eb60256/cf 2023-07-18 04:12:00,994 DEBUG [StoreOpener-305be54eb73d3d4cd32347162eb60256-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testEmptyExportFileSystemState/305be54eb73d3d4cd32347162eb60256/cf 2023-07-18 04:12:00,995 INFO [StoreOpener-305be54eb73d3d4cd32347162eb60256-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 305be54eb73d3d4cd32347162eb60256 columnFamilyName cf 2023-07-18 04:12:00,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689653520389.b6cc8d8d3c819e9b2a7b7daa4a67f78b. 2023-07-18 04:12:00,996 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689653520389.b6cc8d8d3c819e9b2a7b7daa4a67f78b. 2023-07-18 04:12:00,996 INFO [StoreOpener-305be54eb73d3d4cd32347162eb60256-1] regionserver.HStore(310): Store=305be54eb73d3d4cd32347162eb60256/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:12:00,997 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=b6cc8d8d3c819e9b2a7b7daa4a67f78b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:00,997 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689653520389.b6cc8d8d3c819e9b2a7b7daa4a67f78b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689653520997"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689653520997"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689653520997"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689653520997"}]},"ts":"1689653520997"} 2023-07-18 04:12:00,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testEmptyExportFileSystemState/305be54eb73d3d4cd32347162eb60256 2023-07-18 04:12:00,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testEmptyExportFileSystemState/305be54eb73d3d4cd32347162eb60256 2023-07-18 04:12:01,003 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-18 04:12:01,003 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure b6cc8d8d3c819e9b2a7b7daa4a67f78b, server=jenkins-hbase4.apache.org,42889,1689653423206 in 196 msec 2023-07-18 04:12:01,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 305be54eb73d3d4cd32347162eb60256 2023-07-18 04:12:01,007 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b6cc8d8d3c819e9b2a7b7daa4a67f78b, ASSIGN in 365 msec 2023-07-18 04:12:01,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testEmptyExportFileSystemState/305be54eb73d3d4cd32347162eb60256/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 04:12:01,010 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 305be54eb73d3d4cd32347162eb60256; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64620166, jitterRate=-0.037084490060806274}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 04:12:01,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 305be54eb73d3d4cd32347162eb60256: 2023-07-18 04:12:01,011 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689653520389.305be54eb73d3d4cd32347162eb60256., pid=93, masterSystemTime=1689653520955 2023-07-18 04:12:01,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-18 04:12:01,013 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689653520389.305be54eb73d3d4cd32347162eb60256. 2023-07-18 04:12:01,013 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689653520389.305be54eb73d3d4cd32347162eb60256. 2023-07-18 04:12:01,014 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=305be54eb73d3d4cd32347162eb60256, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:01,015 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689653520389.305be54eb73d3d4cd32347162eb60256.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689653521014"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689653521014"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689653521014"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689653521014"}]},"ts":"1689653521014"} 2023-07-18 04:12:01,017 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-18 04:12:01,017 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 305be54eb73d3d4cd32347162eb60256, server=jenkins-hbase4.apache.org,35525,1689653423141 in 214 msec 2023-07-18 04:12:01,019 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-18 04:12:01,019 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=305be54eb73d3d4cd32347162eb60256, ASSIGN in 379 msec 2023-07-18 04:12:01,020 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 04:12:01,020 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653521020"}]},"ts":"1689653521020"} 2023-07-18 04:12:01,021 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-18 04:12:01,024 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 04:12:01,024 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-18 04:12:01,026 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35525] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-18 04:12:01,027 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:01,027 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:01,027 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:01,027 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:01,033 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 04:12:01,033 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 04:12:01,033 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 04:12:01,033 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 04:12:01,034 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 642 msec 2023-07-18 04:12:01,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-18 04:12:01,514 INFO [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-18 04:12:01,516 DEBUG [Listener at jenkins-hbase4.apache.org/40435] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-18 04:12:01,517 DEBUG [Listener at jenkins-hbase4.apache.org/40435] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689653520389.b6cc8d8d3c819e9b2a7b7daa4a67f78b. 2023-07-18 04:12:01,519 INFO [Listener at jenkins-hbase4.apache.org/40435] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 04:12:01,567 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-18 04:12:01,591 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 04:12:01,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689653521591 (current time:1689653521591). 2023-07-18 04:12:01,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 04:12:01,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(139): Connect 0x0633f866 to 127.0.0.1:64260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:12:01,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@294e0108, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:12:01,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:12:01,666 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36860, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:12:01,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0633f866 to 127.0.0.1:64260 2023-07-18 04:12:01,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:12:01,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(139): Connect 0x1dbfd4e7 to 127.0.0.1:64260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:12:01,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d6fffe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:12:01,712 DEBUG [hconnection-0x5dc9f82d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:12:01,722 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36864, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:12:01,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:12:01,733 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40426, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:12:01,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1dbfd4e7 to 127.0.0.1:64260 2023-07-18 04:12:01,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:12:01,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-18 04:12:01,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 04:12:01,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 04:12:01,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-18 04:12:01,745 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-18 04:12:01,748 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689654121748 2023-07-18 04:12:01,748 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-18 04:12:01,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 04:12:01,750 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 04:12:01,751 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 04:12:01,753 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-18 04:12:01,753 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-18 04:12:01,755 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 16 msec 2023-07-18 04:12:01,760 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-18 04:12:01,761 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689654121761 2023-07-18 04:12:01,806 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,807 INFO [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-18 04:12:01,807 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:12:01,809 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-18 04:12:01,809 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-18 04:12:01,810 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,810 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,816 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:01,816 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:01,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:01,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:01,816 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:01,816 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:01,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:01,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:01,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:01,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:01,817 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:01,817 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:01,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,818 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:01,818 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 04:12:01,818 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,823 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,823 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-18 04:12:01,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,823 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-18 04:12:01,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-18 04:12:01,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,824 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-18 04:12:01,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-18 04:12:01,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,825 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-18 04:12:01,833 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,833 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-18 04:12:01,833 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:12:01,835 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-18 04:12:01,835 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-18 04:12:01,835 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42889,1689653423206' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-18 04:12:01,837 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,837 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-18 04:12:01,837 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:12:01,837 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:01,837 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:01,848 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-18 04:12:01,848 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:12:01,848 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-18 04:12:01,850 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-18 04:12:01,837 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,850 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-18 04:12:01,850 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-18 04:12:01,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:12:01,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:12:01,850 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43385,1689653423267' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-18 04:12:01,850 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35525,1689653423141' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-18 04:12:01,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:12:01,851 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,851 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:12:01,851 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:12:01,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:12:01,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 04:12:01,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:12:01,852 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 04:12:01,854 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:01,854 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,855 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,855 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,855 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:12:01,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:01,857 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,857 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:12:01,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:01,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:01,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:12:01,858 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42889,1689653423206' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-18 04:12:01,858 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4bc9f7cc[Count = 1] remaining members to acquire global barrier 2023-07-18 04:12:01,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:01,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:12:01,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:12:01,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:12:01,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:12:01,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:01,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:01,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:01,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:12:01,861 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35525,1689653423141' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-18 04:12:01,861 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4bc9f7cc[Count = 0] remaining members to acquire global barrier 2023-07-18 04:12:01,861 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-18 04:12:01,861 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,862 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,862 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,863 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,863 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-18 04:12:01,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,863 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:01,863 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-18 04:12:01,863 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-18 04:12:01,863 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43385,1689653423267' in zk 2023-07-18 04:12:01,863 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:12:01,863 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:12:01,863 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-18 04:12:01,864 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:01,864 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 04:12:01,864 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:12:01,864 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689653520389.305be54eb73d3d4cd32347162eb60256. 2023-07-18 04:12:01,864 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:12:01,864 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689653520389.305be54eb73d3d4cd32347162eb60256. started... 2023-07-18 04:12:01,864 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689653520389.b6cc8d8d3c819e9b2a7b7daa4a67f78b. 2023-07-18 04:12:01,864 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689653520389.b6cc8d8d3c819e9b2a7b7daa4a67f78b. started... 2023-07-18 04:12:01,864 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b6cc8d8d3c819e9b2a7b7daa4a67f78b: 2023-07-18 04:12:01,866 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 305be54eb73d3d4cd32347162eb60256: 2023-07-18 04:12:01,866 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689653520389.b6cc8d8d3c819e9b2a7b7daa4a67f78b.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,866 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689653520389.305be54eb73d3d4cd32347162eb60256.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,866 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:12:01,866 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:12:01,866 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 04:12:01,866 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-18 04:12:01,867 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:12:01,866 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 04:12:01,867 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-18 04:12:01,928 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689653520389.b6cc8d8d3c819e9b2a7b7daa4a67f78b. completed. 2023-07-18 04:12:01,928 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689653520389.b6cc8d8d3c819e9b2a7b7daa4a67f78b. 2023-07-18 04:12:01,928 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:12:01,928 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:12:01,928 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:01,928 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-18 04:12:01,928 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42889,1689653423206' in zk 2023-07-18 04:12:01,930 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-18 04:12:01,930 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:01,930 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:12:01,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:01,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:12:01,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:12:01,930 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-18 04:12:01,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:12:01,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:12:01,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:01,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:01,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:01,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:12:01,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:01,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:01,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,42889,1689653423206': 2023-07-18 04:12:01,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42889,1689653423206' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-18 04:12:01,970 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689653520389.305be54eb73d3d4cd32347162eb60256. completed. 2023-07-18 04:12:01,970 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689653520389.305be54eb73d3d4cd32347162eb60256. 2023-07-18 04:12:01,971 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:12:01,971 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:12:01,971 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:01,971 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-18 04:12:01,971 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35525,1689653423141' in zk 2023-07-18 04:12:01,975 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-18 04:12:01,975 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:12:01,975 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:01,975 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-18 04:12:01,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:01,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:12:01,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:12:01,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:12:01,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:12:01,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:01,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:01,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:01,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:12:01,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:01,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:01,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:01,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35525,1689653423141': 2023-07-18 04:12:01,991 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35525,1689653423141' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-18 04:12:01,991 INFO [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-18 04:12:01,991 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 04:12:01,991 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 04:12:01,991 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,991 INFO [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 04:12:01,993 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,993 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:01,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,993 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,993 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:01,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:01,993 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:01,994 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,993 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:01,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:12:01,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:12:01,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:01,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:01,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:12:01,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:01,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:01,996 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:01,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,996 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:01,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:12:01,997 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:01,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:01,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:01,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:01,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:12:01,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:01,999 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:01,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:01,999 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:02,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:02,000 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:02,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:02,004 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:02,004 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:02,004 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:02,004 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:02,004 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:02,005 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:02,004 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:02,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:02,005 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:02,005 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:02,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:02,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:02,005 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:02,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:02,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:02,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:02,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:02,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:02,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:02,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:02,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:02,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:02,008 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:02,008 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:02,008 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:02,008 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:02,008 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:02,008 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:02,008 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:12:02,008 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-18 04:12:02,008 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:02,010 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:02,010 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:02,010 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-18 04:12:02,011 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-18 04:12:02,041 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:02,042 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:02,053 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:12:02,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 04:12:02,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:12:02,055 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 04:12:02,355 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:12:02,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 04:12:02,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:12:02,357 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-18 04:12:02,473 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:02,493 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-18 04:12:02,493 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:02,493 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:02,493 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689653521748Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689653522041 (+293 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689653522041Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689653522041Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689653522057 (+16 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689653522467 (+410 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689653522493 (+26 ms) 2023-07-18 04:12:02,497 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-18 04:12:02,499 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 747 msec 2023-07-18 04:12:02,857 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:12:02,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 04:12:02,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 04:12:02,862 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42889] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689653520389.b6cc8d8d3c819e9b2a7b7daa4a67f78b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 04:12:02,863 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35525] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689653520389.305be54eb73d3d4cd32347162eb60256. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 04:12:02,866 DEBUG [Listener at jenkins-hbase4.apache.org/40435] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-18 04:12:02,866 DEBUG [Listener at jenkins-hbase4.apache.org/40435] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689653520389.b6cc8d8d3c819e9b2a7b7daa4a67f78b. 2023-07-18 04:12:02,866 INFO [Listener at jenkins-hbase4.apache.org/40435] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 04:12:02,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 04:12:02,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689653522876 (current time:1689653522876). 2023-07-18 04:12:02,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 04:12:02,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(139): Connect 0x58c3749f to 127.0.0.1:64260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:12:02,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ad9f73a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:12:02,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:12:02,902 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36878, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:12:02,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58c3749f to 127.0.0.1:64260 2023-07-18 04:12:02,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:12:02,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(139): Connect 0x76b6aa15 to 127.0.0.1:64260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:12:02,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35124fd0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:12:02,947 DEBUG [hconnection-0x30771e6f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:12:02,949 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36886, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:12:02,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:12:02,956 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40430, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:12:02,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x76b6aa15 to 127.0.0.1:64260 2023-07-18 04:12:02,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:12:02,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-18 04:12:02,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 04:12:02,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 04:12:02,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-18 04:12:02,961 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-18 04:12:02,962 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689654122962 2023-07-18 04:12:02,962 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-18 04:12:02,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 04:12:02,964 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 04:12:02,964 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 04:12:02,965 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-18 04:12:02,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-18 04:12:02,967 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-18 04:12:02,968 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-18 04:12:02,969 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689654122969 2023-07-18 04:12:02,985 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:02,986 INFO [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-18 04:12:02,986 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:12:02,987 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-18 04:12:02,988 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-18 04:12:02,988 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:02,988 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:03,010 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:03,010 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:03,010 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:03,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:03,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:03,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:03,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:03,010 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:03,011 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:03,011 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:03,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:03,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:03,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:03,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:03,011 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:03,011 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 04:12:03,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:03,011 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:03,012 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:03,012 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:03,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-18 04:12:03,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:03,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-18 04:12:03,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:03,012 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-18 04:12:03,012 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-18 04:12:03,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-18 04:12:03,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:03,012 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:03,012 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-18 04:12:03,013 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:03,013 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-18 04:12:03,013 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-18 04:12:03,013 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:03,013 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:12:03,013 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-18 04:12:03,013 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:12:03,013 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:12:03,016 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-18 04:12:03,016 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-18 04:12:03,014 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-18 04:12:03,019 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35525,1689653423141' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-18 04:12:03,019 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-18 04:12:03,020 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-18 04:12:03,020 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42889,1689653423206' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-18 04:12:03,020 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-18 04:12:03,020 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43385,1689653423267' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-18 04:12:03,033 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:03,033 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:03,033 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:03,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:03,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:12:03,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:12:03,057 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:03,057 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:03,058 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:03,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:12:03,057 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:03,058 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:12:03,058 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:12:03,058 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:03,058 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:12:03,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:12:03,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:03,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:03,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:03,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:03,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:12:03,060 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35525,1689653423141' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-18 04:12:03,060 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1096dfd7[Count = 1] remaining members to acquire global barrier 2023-07-18 04:12:03,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:03,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:12:03,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:12:03,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:12:03,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:12:03,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:03,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:03,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:03,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:03,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:12:03,062 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42889,1689653423206' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-18 04:12:03,062 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1096dfd7[Count = 0] remaining members to acquire global barrier 2023-07-18 04:12:03,062 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-18 04:12:03,063 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:03,064 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:12:03,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 04:12:03,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:12:03,066 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 04:12:03,076 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:03,076 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:03,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:03,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:03,076 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:03,076 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-18 04:12:03,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:03,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:03,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:03,076 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-18 04:12:03,077 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-18 04:12:03,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:03,077 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:03,077 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:12:03,077 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43385,1689653423267' in zk 2023-07-18 04:12:03,077 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689653520389.b6cc8d8d3c819e9b2a7b7daa4a67f78b. 2023-07-18 04:12:03,077 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:12:03,077 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-18 04:12:03,077 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689653520389.b6cc8d8d3c819e9b2a7b7daa4a67f78b. started... 2023-07-18 04:12:03,077 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:12:03,077 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:12:03,077 INFO [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b6cc8d8d3c819e9b2a7b7daa4a67f78b 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-18 04:12:03,077 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689653520389.305be54eb73d3d4cd32347162eb60256. 2023-07-18 04:12:03,078 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689653520389.305be54eb73d3d4cd32347162eb60256. started... 2023-07-18 04:12:03,078 INFO [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 305be54eb73d3d4cd32347162eb60256 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-18 04:12:03,079 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-18 04:12:03,079 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:12:03,079 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-18 04:12:03,091 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:03,091 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 04:12:03,114 INFO [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071842bdd685329a4509afe830f5d8a58ff2 to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071842bdd685329a4509afe830f5d8a58ff2 2023-07-18 04:12:03,176 INFO [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testEmptyExportFileSystemState/305be54eb73d3d4cd32347162eb60256/.tmp/cf/e2002b0e36ce4ec2b39999ebbfa8c88f 2023-07-18 04:12:03,183 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testEmptyExportFileSystemState/305be54eb73d3d4cd32347162eb60256/.tmp/cf/e2002b0e36ce4ec2b39999ebbfa8c88f as hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testEmptyExportFileSystemState/305be54eb73d3d4cd32347162eb60256/cf/e2002b0e36ce4ec2b39999ebbfa8c88f 2023-07-18 04:12:03,190 INFO [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testEmptyExportFileSystemState/305be54eb73d3d4cd32347162eb60256/cf/e2002b0e36ce4ec2b39999ebbfa8c88f, entries=44, sequenceid=6, filesize=12.6 K 2023-07-18 04:12:03,200 INFO [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 305be54eb73d3d4cd32347162eb60256 in 122ms, sequenceid=6, compaction requested=false 2023-07-18 04:12:03,202 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 305be54eb73d3d4cd32347162eb60256: 2023-07-18 04:12:03,203 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689653520389.305be54eb73d3d4cd32347162eb60256.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:03,203 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:12:03,203 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testEmptyExportFileSystemState/305be54eb73d3d4cd32347162eb60256/cf/e2002b0e36ce4ec2b39999ebbfa8c88f] hfiles 2023-07-18 04:12:03,203 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testEmptyExportFileSystemState/305be54eb73d3d4cd32347162eb60256/cf/e2002b0e36ce4ec2b39999ebbfa8c88f for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:03,266 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:12:03,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 04:12:03,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:12:03,267 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 04:12:03,557 INFO [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071842d58a1fdf60492bbfe31284041176c8 to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023071842d58a1fdf60492bbfe31284041176c8 2023-07-18 04:12:03,568 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:12:03,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 04:12:03,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:12:03,569 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-18 04:12:03,643 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689653520389.305be54eb73d3d4cd32347162eb60256. completed. 2023-07-18 04:12:03,643 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689653520389.305be54eb73d3d4cd32347162eb60256. 2023-07-18 04:12:03,644 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:12:03,644 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:12:03,644 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:03,644 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-18 04:12:03,644 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35525,1689653423141' in zk 2023-07-18 04:12:03,646 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:03,646 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-18 04:12:03,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:03,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:12:03,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:12:03,646 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:12:03,646 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-18 04:12:03,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:12:03,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:12:03,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:03,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:03,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:03,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:03,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:12:03,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:03,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:03,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:03,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35525,1689653423141': 2023-07-18 04:12:03,652 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35525,1689653423141' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-18 04:12:03,972 INFO [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testEmptyExportFileSystemState/b6cc8d8d3c819e9b2a7b7daa4a67f78b/.tmp/cf/29e2d49d98e54d7b8cbce0b49a10d331 2023-07-18 04:12:04,000 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testEmptyExportFileSystemState/b6cc8d8d3c819e9b2a7b7daa4a67f78b/.tmp/cf/29e2d49d98e54d7b8cbce0b49a10d331 as hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testEmptyExportFileSystemState/b6cc8d8d3c819e9b2a7b7daa4a67f78b/cf/29e2d49d98e54d7b8cbce0b49a10d331 2023-07-18 04:12:04,017 INFO [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testEmptyExportFileSystemState/b6cc8d8d3c819e9b2a7b7daa4a67f78b/cf/29e2d49d98e54d7b8cbce0b49a10d331, entries=6, sequenceid=6, filesize=5.9 K 2023-07-18 04:12:04,019 INFO [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for b6cc8d8d3c819e9b2a7b7daa4a67f78b in 942ms, sequenceid=6, compaction requested=false 2023-07-18 04:12:04,019 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b6cc8d8d3c819e9b2a7b7daa4a67f78b: 2023-07-18 04:12:04,019 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689653520389.b6cc8d8d3c819e9b2a7b7daa4a67f78b.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:04,025 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:12:04,025 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testEmptyExportFileSystemState/b6cc8d8d3c819e9b2a7b7daa4a67f78b/cf/29e2d49d98e54d7b8cbce0b49a10d331] hfiles 2023-07-18 04:12:04,025 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testEmptyExportFileSystemState/b6cc8d8d3c819e9b2a7b7daa4a67f78b/cf/29e2d49d98e54d7b8cbce0b49a10d331 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:04,059 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689653520389.b6cc8d8d3c819e9b2a7b7daa4a67f78b. completed. 2023-07-18 04:12:04,059 DEBUG [rs(jenkins-hbase4.apache.org,42889,1689653423206)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689653520389.b6cc8d8d3c819e9b2a7b7daa4a67f78b. 2023-07-18 04:12:04,059 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:12:04,059 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:12:04,059 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:04,059 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-18 04:12:04,059 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42889,1689653423206' in zk 2023-07-18 04:12:04,061 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:04,061 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-18 04:12:04,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:04,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:12:04,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:12:04,061 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:12:04,061 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-18 04:12:04,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:12:04,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:12:04,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:04,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:04,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:04,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:04,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:12:04,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:04,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:04,069 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:12:04,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 04:12:04,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:12:04,071 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-18 04:12:04,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:04,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:04,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,42889,1689653423206': 2023-07-18 04:12:04,072 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42889,1689653423206' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-18 04:12:04,072 INFO [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-18 04:12:04,072 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 04:12:04,072 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 04:12:04,072 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:04,072 INFO [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 04:12:04,075 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:04,075 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:04,075 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:04,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:04,075 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:04,075 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:04,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:04,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:04,075 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:04,075 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:04,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:04,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:04,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:12:04,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:04,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:04,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:12:04,076 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:04,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:04,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:04,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:04,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:12:04,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:04,077 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:04,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:04,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:04,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:04,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:04,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:04,077 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:04,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:04,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:12:04,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:04,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:04,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:04,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:04,079 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:04,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:12:04,080 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:04,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:04,080 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:04,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:04,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:04,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:04,083 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:04,083 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:04,083 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:04,083 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:04,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:04,083 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:04,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:04,083 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:04,083 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:04,084 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:04,084 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:12:04,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:04,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:04,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:04,083 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:04,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:04,084 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-18 04:12:04,084 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:04,086 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:04,086 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:04,086 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:04,086 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:04,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:04,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:04,086 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-18 04:12:04,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:04,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:04,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:04,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:04,086 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:04,086 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:04,086 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:04,086 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:04,086 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:04,087 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071842bdd685329a4509afe830f5d8a58ff2, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023071842d58a1fdf60492bbfe31284041176c8] mob files 2023-07-18 04:12:04,087 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071842bdd685329a4509afe830f5d8a58ff2 2023-07-18 04:12:04,087 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023071842d58a1fdf60492bbfe31284041176c8 2023-07-18 04:12:04,098 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:04,099 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:04,131 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:04,189 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-18 04:12:04,189 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:04,190 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:04,190 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689653522962Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689653524098 (+1136 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689653524098Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689653524098Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689653524102 (+4 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689653524119 (+17 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689653524189 (+70 ms) 2023-07-18 04:12:04,195 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-18 04:12:04,196 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 1.2320 sec 2023-07-18 04:12:04,416 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653430729_0005_000001 (auth:SIMPLE) 2023-07-18 04:12:05,071 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:12:05,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 04:12:05,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 04:12:05,073 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653525073 2023-07-18 04:12:05,074 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43229, tgtDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653525073, rawTgtDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653525073, srcFsUri=hdfs://localhost:43229, srcDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8 2023-07-18 04:12:05,109 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43229, inputRoot=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8 2023-07-18 04:12:05,109 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-80221228_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653525073, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653525073/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,109 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43229, inputRoot=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8, snapshotDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-18 04:12:05,122 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653525073/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:05,156 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 04:12:05,209 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:05,210 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:05,210 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:05,211 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:05,211 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:05,212 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:05,212 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:05,307 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/hadoop-1119188004671044474.jar 2023-07-18 04:12:05,308 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:05,308 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:05,309 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:05,309 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:05,310 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:05,310 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:05,311 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 04:12:05,311 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 04:12:05,312 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 04:12:05,312 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 04:12:05,313 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 04:12:05,313 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 04:12:05,314 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 04:12:05,314 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 04:12:05,315 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 04:12:05,316 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 04:12:05,316 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:12:05,317 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:12:05,317 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 04:12:05,317 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:12:05,318 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:12:05,318 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 04:12:05,318 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 04:12:06,561 WARN [Listener at jenkins-hbase4.apache.org/40435] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 04:12:06,564 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-18 04:12:07,089 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 04:12:07,089 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 04:12:07,420 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653430729_0006_000001 (auth:SIMPLE) 2023-07-18 04:12:13,201 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653430729_0006_000001 (auth:SIMPLE) 2023-07-18 04:12:16,436 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 04:12:16,437 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 04:12:16,447 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:16,447 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 04:12:16,448 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 04:12:16,448 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-559505343_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:16,449 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(367): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-18 04:12:16,449 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(367): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-18 04:12:16,449 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-559505343_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653525073/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653525073/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:16,449 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(367): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653525073/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-18 04:12:16,449 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(367): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653525073/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-18 04:12:16,455 INFO [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-18 04:12:16,456 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-18 04:12:16,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 04:12:16,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-18 04:12:16,461 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653536461"}]},"ts":"1689653536461"} 2023-07-18 04:12:16,462 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-18 04:12:16,464 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-18 04:12:16,465 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b6cc8d8d3c819e9b2a7b7daa4a67f78b, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=305be54eb73d3d4cd32347162eb60256, UNASSIGN}] 2023-07-18 04:12:16,465 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b6cc8d8d3c819e9b2a7b7daa4a67f78b, UNASSIGN 2023-07-18 04:12:16,467 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=305be54eb73d3d4cd32347162eb60256, UNASSIGN 2023-07-18 04:12:16,468 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=b6cc8d8d3c819e9b2a7b7daa4a67f78b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:16,468 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689653520389.b6cc8d8d3c819e9b2a7b7daa4a67f78b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689653536468"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653536468"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653536468"}]},"ts":"1689653536468"} 2023-07-18 04:12:16,469 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=305be54eb73d3d4cd32347162eb60256, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:16,469 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689653520389.305be54eb73d3d4cd32347162eb60256.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689653536469"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653536469"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653536469"}]},"ts":"1689653536469"} 2023-07-18 04:12:16,470 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure b6cc8d8d3c819e9b2a7b7daa4a67f78b, server=jenkins-hbase4.apache.org,42889,1689653423206}] 2023-07-18 04:12:16,471 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 305be54eb73d3d4cd32347162eb60256, server=jenkins-hbase4.apache.org,35525,1689653423141}] 2023-07-18 04:12:16,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-18 04:12:16,623 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b6cc8d8d3c819e9b2a7b7daa4a67f78b 2023-07-18 04:12:16,623 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b6cc8d8d3c819e9b2a7b7daa4a67f78b, disabling compactions & flushes 2023-07-18 04:12:16,623 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689653520389.b6cc8d8d3c819e9b2a7b7daa4a67f78b. 2023-07-18 04:12:16,623 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689653520389.b6cc8d8d3c819e9b2a7b7daa4a67f78b. 2023-07-18 04:12:16,623 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689653520389.b6cc8d8d3c819e9b2a7b7daa4a67f78b. after waiting 0 ms 2023-07-18 04:12:16,623 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689653520389.b6cc8d8d3c819e9b2a7b7daa4a67f78b. 2023-07-18 04:12:16,624 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 305be54eb73d3d4cd32347162eb60256 2023-07-18 04:12:16,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 305be54eb73d3d4cd32347162eb60256, disabling compactions & flushes 2023-07-18 04:12:16,624 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689653520389.305be54eb73d3d4cd32347162eb60256. 2023-07-18 04:12:16,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689653520389.305be54eb73d3d4cd32347162eb60256. 2023-07-18 04:12:16,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689653520389.305be54eb73d3d4cd32347162eb60256. after waiting 0 ms 2023-07-18 04:12:16,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689653520389.305be54eb73d3d4cd32347162eb60256. 2023-07-18 04:12:16,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testEmptyExportFileSystemState/305be54eb73d3d4cd32347162eb60256/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 04:12:16,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testEmptyExportFileSystemState/b6cc8d8d3c819e9b2a7b7daa4a67f78b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 04:12:16,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:12:16,644 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689653520389.305be54eb73d3d4cd32347162eb60256. 2023-07-18 04:12:16,644 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:12:16,644 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 305be54eb73d3d4cd32347162eb60256: 2023-07-18 04:12:16,645 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689653520389.b6cc8d8d3c819e9b2a7b7daa4a67f78b. 2023-07-18 04:12:16,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b6cc8d8d3c819e9b2a7b7daa4a67f78b: 2023-07-18 04:12:16,646 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 305be54eb73d3d4cd32347162eb60256 2023-07-18 04:12:16,648 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=305be54eb73d3d4cd32347162eb60256, regionState=CLOSED 2023-07-18 04:12:16,648 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689653520389.305be54eb73d3d4cd32347162eb60256.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689653536648"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653536648"}]},"ts":"1689653536648"} 2023-07-18 04:12:16,648 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b6cc8d8d3c819e9b2a7b7daa4a67f78b 2023-07-18 04:12:16,649 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=b6cc8d8d3c819e9b2a7b7daa4a67f78b, regionState=CLOSED 2023-07-18 04:12:16,649 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689653520389.b6cc8d8d3c819e9b2a7b7daa4a67f78b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689653536649"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653536649"}]},"ts":"1689653536649"} 2023-07-18 04:12:16,652 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-18 04:12:16,652 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 305be54eb73d3d4cd32347162eb60256, server=jenkins-hbase4.apache.org,35525,1689653423141 in 179 msec 2023-07-18 04:12:16,652 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-18 04:12:16,652 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure b6cc8d8d3c819e9b2a7b7daa4a67f78b, server=jenkins-hbase4.apache.org,42889,1689653423206 in 181 msec 2023-07-18 04:12:16,653 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=305be54eb73d3d4cd32347162eb60256, UNASSIGN in 187 msec 2023-07-18 04:12:16,654 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-18 04:12:16,654 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b6cc8d8d3c819e9b2a7b7daa4a67f78b, UNASSIGN in 187 msec 2023-07-18 04:12:16,654 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653536654"}]},"ts":"1689653536654"} 2023-07-18 04:12:16,656 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-18 04:12:16,657 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-18 04:12:16,659 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 202 msec 2023-07-18 04:12:16,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-18 04:12:16,763 INFO [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-18 04:12:16,764 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-18 04:12:16,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 04:12:16,772 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 04:12:16,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-18 04:12:16,773 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 04:12:16,774 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35525] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-18 04:12:16,779 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 04:12:16,779 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 04:12:16,779 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-18 04:12:16,779 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 04:12:16,780 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-18 04:12:16,780 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 04:12:16,780 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-18 04:12:16,784 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-18 04:12:16,785 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 04:12:16,785 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:16,785 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 04:12:16,785 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:16,785 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 04:12:16,785 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:16,785 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 04:12:16,785 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:16,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-18 04:12:16,786 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testEmptyExportFileSystemState/305be54eb73d3d4cd32347162eb60256 2023-07-18 04:12:16,787 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testEmptyExportFileSystemState/b6cc8d8d3c819e9b2a7b7daa4a67f78b 2023-07-18 04:12:16,789 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testEmptyExportFileSystemState/305be54eb73d3d4cd32347162eb60256/cf, FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testEmptyExportFileSystemState/305be54eb73d3d4cd32347162eb60256/recovered.edits] 2023-07-18 04:12:16,790 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testEmptyExportFileSystemState/b6cc8d8d3c819e9b2a7b7daa4a67f78b/cf, FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testEmptyExportFileSystemState/b6cc8d8d3c819e9b2a7b7daa4a67f78b/recovered.edits] 2023-07-18 04:12:16,796 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testEmptyExportFileSystemState/305be54eb73d3d4cd32347162eb60256/cf/e2002b0e36ce4ec2b39999ebbfa8c88f to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/archive/data/default/testtb-testEmptyExportFileSystemState/305be54eb73d3d4cd32347162eb60256/cf/e2002b0e36ce4ec2b39999ebbfa8c88f 2023-07-18 04:12:16,799 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testEmptyExportFileSystemState/b6cc8d8d3c819e9b2a7b7daa4a67f78b/cf/29e2d49d98e54d7b8cbce0b49a10d331 to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/archive/data/default/testtb-testEmptyExportFileSystemState/b6cc8d8d3c819e9b2a7b7daa4a67f78b/cf/29e2d49d98e54d7b8cbce0b49a10d331 2023-07-18 04:12:16,801 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testEmptyExportFileSystemState/305be54eb73d3d4cd32347162eb60256/recovered.edits/9.seqid to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/archive/data/default/testtb-testEmptyExportFileSystemState/305be54eb73d3d4cd32347162eb60256/recovered.edits/9.seqid 2023-07-18 04:12:16,802 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testEmptyExportFileSystemState/305be54eb73d3d4cd32347162eb60256 2023-07-18 04:12:16,805 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testEmptyExportFileSystemState/b6cc8d8d3c819e9b2a7b7daa4a67f78b/recovered.edits/9.seqid to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/archive/data/default/testtb-testEmptyExportFileSystemState/b6cc8d8d3c819e9b2a7b7daa4a67f78b/recovered.edits/9.seqid 2023-07-18 04:12:16,807 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testEmptyExportFileSystemState/b6cc8d8d3c819e9b2a7b7daa4a67f78b 2023-07-18 04:12:16,807 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-18 04:12:16,807 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-18 04:12:16,808 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-18 04:12:16,813 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071842bdd685329a4509afe830f5d8a58ff2 to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071842bdd685329a4509afe830f5d8a58ff2 2023-07-18 04:12:16,815 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023071842d58a1fdf60492bbfe31284041176c8 to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023071842d58a1fdf60492bbfe31284041176c8 2023-07-18 04:12:16,816 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-18 04:12:16,819 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 04:12:16,829 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-18 04:12:16,844 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-18 04:12:16,846 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 04:12:16,846 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-18 04:12:16,846 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689653520389.b6cc8d8d3c819e9b2a7b7daa4a67f78b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689653536846"}]},"ts":"9223372036854775807"} 2023-07-18 04:12:16,846 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689653520389.305be54eb73d3d4cd32347162eb60256.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689653536846"}]},"ts":"9223372036854775807"} 2023-07-18 04:12:16,860 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-18 04:12:16,860 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b6cc8d8d3c819e9b2a7b7daa4a67f78b, NAME => 'testtb-testEmptyExportFileSystemState,,1689653520389.b6cc8d8d3c819e9b2a7b7daa4a67f78b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 305be54eb73d3d4cd32347162eb60256, NAME => 'testtb-testEmptyExportFileSystemState,1,1689653520389.305be54eb73d3d4cd32347162eb60256.', STARTKEY => '1', ENDKEY => ''}] 2023-07-18 04:12:16,860 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-18 04:12:16,860 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689653536860"}]},"ts":"9223372036854775807"} 2023-07-18 04:12:16,865 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-18 04:12:16,868 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 04:12:16,869 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 104 msec 2023-07-18 04:12:16,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-18 04:12:16,887 INFO [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-18 04:12:16,895 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-18 04:12:16,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:16,898 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-18 04:12:16,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-18 04:12:16,930 INFO [Listener at jenkins-hbase4.apache.org/40435] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=762 (was 759) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1213067643_1 at /127.0.0.1:35190 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-559505343_17 at /127.0.0.1:49678 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1966361669) connection to jenkins-hbase4.apache.org/172.31.14.131:45405 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-5019 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0xf2856f0-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1966361669) connection to jenkins-hbase4.apache.org/172.31.14.131:40435 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1966361669) connection to jenkins-hbase4.apache.org/172.31.14.131:42793 from appattempt_1689653430729_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xf2856f0-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-559505343_17 at /127.0.0.1:35220 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-559505343_17 at /127.0.0.1:35204 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xf2856f0-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xf2856f0-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1213067643_1 at /127.0.0.1:35188 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=928 (was 906) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=488 (was 373) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 186), AvailableMemoryMB=1766 (was 2821) 2023-07-18 04:12:16,930 WARN [Listener at jenkins-hbase4.apache.org/40435] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-18 04:12:16,951 INFO [Listener at jenkins-hbase4.apache.org/40435] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=762, OpenFileDescriptor=928, MaxFileDescriptor=60000, SystemLoadAverage=488, ProcessCount=183, AvailableMemoryMB=1766 2023-07-18 04:12:16,952 WARN [Listener at jenkins-hbase4.apache.org/40435] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-18 04:12:16,953 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-18 04:12:16,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:16,956 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 04:12:16,956 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-18 04:12:16,957 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 04:12:16,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-18 04:12:16,959 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef94f9b8efbe86ebbe1257ed58925d0a 2023-07-18 04:12:16,959 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/08bd493c16381be9c1011131de8722b7 2023-07-18 04:12:16,959 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef94f9b8efbe86ebbe1257ed58925d0a empty. 2023-07-18 04:12:16,959 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/08bd493c16381be9c1011131de8722b7 empty. 2023-07-18 04:12:16,960 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef94f9b8efbe86ebbe1257ed58925d0a 2023-07-18 04:12:16,960 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/08bd493c16381be9c1011131de8722b7 2023-07-18 04:12:16,960 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-18 04:12:16,969 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-18 04:12:16,971 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 08bd493c16381be9c1011131de8722b7, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689653536953.08bd493c16381be9c1011131de8722b7.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp 2023-07-18 04:12:16,971 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => ef94f9b8efbe86ebbe1257ed58925d0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689653536953.ef94f9b8efbe86ebbe1257ed58925d0a.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp 2023-07-18 04:12:16,978 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689653536953.ef94f9b8efbe86ebbe1257ed58925d0a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:12:16,978 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689653536953.08bd493c16381be9c1011131de8722b7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:12:16,978 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing ef94f9b8efbe86ebbe1257ed58925d0a, disabling compactions & flushes 2023-07-18 04:12:16,978 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 08bd493c16381be9c1011131de8722b7, disabling compactions & flushes 2023-07-18 04:12:16,979 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689653536953.ef94f9b8efbe86ebbe1257ed58925d0a. 2023-07-18 04:12:16,979 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689653536953.08bd493c16381be9c1011131de8722b7. 2023-07-18 04:12:16,979 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689653536953.ef94f9b8efbe86ebbe1257ed58925d0a. 2023-07-18 04:12:16,979 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689653536953.08bd493c16381be9c1011131de8722b7. 2023-07-18 04:12:16,979 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689653536953.ef94f9b8efbe86ebbe1257ed58925d0a. after waiting 0 ms 2023-07-18 04:12:16,979 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689653536953.ef94f9b8efbe86ebbe1257ed58925d0a. 2023-07-18 04:12:16,979 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689653536953.08bd493c16381be9c1011131de8722b7. after waiting 0 ms 2023-07-18 04:12:16,979 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689653536953.08bd493c16381be9c1011131de8722b7. 2023-07-18 04:12:16,979 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689653536953.ef94f9b8efbe86ebbe1257ed58925d0a. 2023-07-18 04:12:16,979 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689653536953.08bd493c16381be9c1011131de8722b7. 2023-07-18 04:12:16,979 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for ef94f9b8efbe86ebbe1257ed58925d0a: 2023-07-18 04:12:16,979 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 08bd493c16381be9c1011131de8722b7: 2023-07-18 04:12:16,981 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 04:12:16,982 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689653536953.ef94f9b8efbe86ebbe1257ed58925d0a.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689653536982"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653536982"}]},"ts":"1689653536982"} 2023-07-18 04:12:16,982 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689653536953.08bd493c16381be9c1011131de8722b7.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689653536982"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653536982"}]},"ts":"1689653536982"} 2023-07-18 04:12:16,984 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 04:12:16,985 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 04:12:16,985 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653536985"}]},"ts":"1689653536985"} 2023-07-18 04:12:16,986 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-18 04:12:16,989 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 04:12:16,990 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 04:12:16,990 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 04:12:16,990 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 04:12:16,990 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 04:12:16,991 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ef94f9b8efbe86ebbe1257ed58925d0a, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=08bd493c16381be9c1011131de8722b7, ASSIGN}] 2023-07-18 04:12:16,993 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ef94f9b8efbe86ebbe1257ed58925d0a, ASSIGN 2023-07-18 04:12:16,993 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=08bd493c16381be9c1011131de8722b7, ASSIGN 2023-07-18 04:12:16,994 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=08bd493c16381be9c1011131de8722b7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35525,1689653423141; forceNewPlan=false, retain=false 2023-07-18 04:12:16,994 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ef94f9b8efbe86ebbe1257ed58925d0a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43385,1689653423267; forceNewPlan=false, retain=false 2023-07-18 04:12:17,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-18 04:12:17,144 INFO [jenkins-hbase4:46231] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 04:12:17,148 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=ef94f9b8efbe86ebbe1257ed58925d0a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:17,148 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689653536953.ef94f9b8efbe86ebbe1257ed58925d0a.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689653537148"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653537148"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653537148"}]},"ts":"1689653537148"} 2023-07-18 04:12:17,148 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=08bd493c16381be9c1011131de8722b7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:17,149 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689653536953.08bd493c16381be9c1011131de8722b7.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689653537148"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653537148"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653537148"}]},"ts":"1689653537148"} 2023-07-18 04:12:17,150 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure ef94f9b8efbe86ebbe1257ed58925d0a, server=jenkins-hbase4.apache.org,43385,1689653423267}] 2023-07-18 04:12:17,151 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 08bd493c16381be9c1011131de8722b7, server=jenkins-hbase4.apache.org,35525,1689653423141}] 2023-07-18 04:12:17,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-18 04:12:17,310 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689653536953.08bd493c16381be9c1011131de8722b7. 2023-07-18 04:12:17,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 08bd493c16381be9c1011131de8722b7, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689653536953.08bd493c16381be9c1011131de8722b7.', STARTKEY => '1', ENDKEY => ''} 2023-07-18 04:12:17,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689653536953.08bd493c16381be9c1011131de8722b7. service=AccessControlService 2023-07-18 04:12:17,311 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:12:17,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 08bd493c16381be9c1011131de8722b7 2023-07-18 04:12:17,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689653536953.08bd493c16381be9c1011131de8722b7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:12:17,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 08bd493c16381be9c1011131de8722b7 2023-07-18 04:12:17,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 08bd493c16381be9c1011131de8722b7 2023-07-18 04:12:17,312 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689653536953.ef94f9b8efbe86ebbe1257ed58925d0a. 2023-07-18 04:12:17,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ef94f9b8efbe86ebbe1257ed58925d0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689653536953.ef94f9b8efbe86ebbe1257ed58925d0a.', STARTKEY => '', ENDKEY => '1'} 2023-07-18 04:12:17,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689653536953.ef94f9b8efbe86ebbe1257ed58925d0a. service=AccessControlService 2023-07-18 04:12:17,312 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 04:12:17,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp ef94f9b8efbe86ebbe1257ed58925d0a 2023-07-18 04:12:17,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689653536953.ef94f9b8efbe86ebbe1257ed58925d0a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 04:12:17,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ef94f9b8efbe86ebbe1257ed58925d0a 2023-07-18 04:12:17,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ef94f9b8efbe86ebbe1257ed58925d0a 2023-07-18 04:12:17,314 INFO [StoreOpener-08bd493c16381be9c1011131de8722b7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 08bd493c16381be9c1011131de8722b7 2023-07-18 04:12:17,314 INFO [StoreOpener-ef94f9b8efbe86ebbe1257ed58925d0a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ef94f9b8efbe86ebbe1257ed58925d0a 2023-07-18 04:12:17,315 DEBUG [StoreOpener-08bd493c16381be9c1011131de8722b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithSkipTmp/08bd493c16381be9c1011131de8722b7/cf 2023-07-18 04:12:17,315 DEBUG [StoreOpener-ef94f9b8efbe86ebbe1257ed58925d0a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef94f9b8efbe86ebbe1257ed58925d0a/cf 2023-07-18 04:12:17,315 DEBUG [StoreOpener-08bd493c16381be9c1011131de8722b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithSkipTmp/08bd493c16381be9c1011131de8722b7/cf 2023-07-18 04:12:17,315 DEBUG [StoreOpener-ef94f9b8efbe86ebbe1257ed58925d0a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef94f9b8efbe86ebbe1257ed58925d0a/cf 2023-07-18 04:12:17,316 INFO [StoreOpener-08bd493c16381be9c1011131de8722b7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08bd493c16381be9c1011131de8722b7 columnFamilyName cf 2023-07-18 04:12:17,316 INFO [StoreOpener-ef94f9b8efbe86ebbe1257ed58925d0a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef94f9b8efbe86ebbe1257ed58925d0a columnFamilyName cf 2023-07-18 04:12:17,317 INFO [StoreOpener-ef94f9b8efbe86ebbe1257ed58925d0a-1] regionserver.HStore(310): Store=ef94f9b8efbe86ebbe1257ed58925d0a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:12:17,317 INFO [StoreOpener-08bd493c16381be9c1011131de8722b7-1] regionserver.HStore(310): Store=08bd493c16381be9c1011131de8722b7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 04:12:17,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithSkipTmp/08bd493c16381be9c1011131de8722b7 2023-07-18 04:12:17,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef94f9b8efbe86ebbe1257ed58925d0a 2023-07-18 04:12:17,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithSkipTmp/08bd493c16381be9c1011131de8722b7 2023-07-18 04:12:17,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef94f9b8efbe86ebbe1257ed58925d0a 2023-07-18 04:12:17,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ef94f9b8efbe86ebbe1257ed58925d0a 2023-07-18 04:12:17,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 08bd493c16381be9c1011131de8722b7 2023-07-18 04:12:17,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef94f9b8efbe86ebbe1257ed58925d0a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 04:12:17,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithSkipTmp/08bd493c16381be9c1011131de8722b7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 04:12:17,325 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ef94f9b8efbe86ebbe1257ed58925d0a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74044209, jitterRate=0.10334469377994537}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 04:12:17,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ef94f9b8efbe86ebbe1257ed58925d0a: 2023-07-18 04:12:17,326 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 08bd493c16381be9c1011131de8722b7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73912423, jitterRate=0.10138092935085297}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 04:12:17,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 08bd493c16381be9c1011131de8722b7: 2023-07-18 04:12:17,326 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689653536953.ef94f9b8efbe86ebbe1257ed58925d0a., pid=108, masterSystemTime=1689653537303 2023-07-18 04:12:17,327 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689653536953.08bd493c16381be9c1011131de8722b7., pid=109, masterSystemTime=1689653537303 2023-07-18 04:12:17,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689653536953.ef94f9b8efbe86ebbe1257ed58925d0a. 2023-07-18 04:12:17,328 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689653536953.ef94f9b8efbe86ebbe1257ed58925d0a. 2023-07-18 04:12:17,329 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=ef94f9b8efbe86ebbe1257ed58925d0a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:17,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689653536953.08bd493c16381be9c1011131de8722b7. 2023-07-18 04:12:17,329 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689653536953.08bd493c16381be9c1011131de8722b7. 2023-07-18 04:12:17,329 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689653536953.ef94f9b8efbe86ebbe1257ed58925d0a.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689653537329"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689653537329"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689653537329"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689653537329"}]},"ts":"1689653537329"} 2023-07-18 04:12:17,329 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=08bd493c16381be9c1011131de8722b7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:17,329 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689653536953.08bd493c16381be9c1011131de8722b7.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689653537329"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689653537329"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689653537329"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689653537329"}]},"ts":"1689653537329"} 2023-07-18 04:12:17,333 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-18 04:12:17,333 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure ef94f9b8efbe86ebbe1257ed58925d0a, server=jenkins-hbase4.apache.org,43385,1689653423267 in 180 msec 2023-07-18 04:12:17,334 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-18 04:12:17,334 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 08bd493c16381be9c1011131de8722b7, server=jenkins-hbase4.apache.org,35525,1689653423141 in 181 msec 2023-07-18 04:12:17,334 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ef94f9b8efbe86ebbe1257ed58925d0a, ASSIGN in 342 msec 2023-07-18 04:12:17,335 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-18 04:12:17,335 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=08bd493c16381be9c1011131de8722b7, ASSIGN in 343 msec 2023-07-18 04:12:17,336 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 04:12:17,336 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653537336"}]},"ts":"1689653537336"} 2023-07-18 04:12:17,337 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-18 04:12:17,339 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 04:12:17,339 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-18 04:12:17,341 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35525] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-18 04:12:17,342 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:17,342 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:17,342 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:17,342 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:17,344 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-18 04:12:17,344 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-18 04:12:17,344 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-18 04:12:17,344 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-18 04:12:17,345 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 391 msec 2023-07-18 04:12:17,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-18 04:12:17,561 INFO [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-18 04:12:17,563 DEBUG [Listener at jenkins-hbase4.apache.org/40435] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,564 DEBUG [Listener at jenkins-hbase4.apache.org/40435] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689653536953.ef94f9b8efbe86ebbe1257ed58925d0a. 2023-07-18 04:12:17,566 INFO [Listener at jenkins-hbase4.apache.org/40435] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 04:12:17,578 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-18 04:12:17,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689653537578 (current time:1689653537578). 2023-07-18 04:12:17,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 04:12:17,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(139): Connect 0x727fe90c to 127.0.0.1:64260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:12:17,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@397c7093, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:12:17,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:12:17,592 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42128, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:12:17,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x727fe90c to 127.0.0.1:64260 2023-07-18 04:12:17,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:12:17,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(139): Connect 0x54d2e8bd to 127.0.0.1:64260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:12:17,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59e84ca2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:12:17,606 DEBUG [hconnection-0x34a47e4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:12:17,609 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42136, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:12:17,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:12:17,615 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41262, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:12:17,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54d2e8bd to 127.0.0.1:64260 2023-07-18 04:12:17,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:12:17,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-18 04:12:17,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 04:12:17,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-18 04:12:17,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-18 04:12:17,622 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-18 04:12:17,622 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689654137622 2023-07-18 04:12:17,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-18 04:12:17,622 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,623 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 04:12:17,624 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 04:12:17,625 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-18 04:12:17,625 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-18 04:12:17,628 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-07-18 04:12:17,632 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-18 04:12:17,632 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689654137632 2023-07-18 04:12:17,646 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,646 INFO [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-18 04:12:17,646 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:12:17,648 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-18 04:12:17,648 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-18 04:12:17,648 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,648 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,651 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:17,651 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:17,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:17,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:17,651 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:17,651 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:17,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:17,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:17,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:17,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:17,651 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:17,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,652 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:17,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,652 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,652 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:17,652 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 04:12:17,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-18 04:12:17,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,653 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-18 04:12:17,653 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,653 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-18 04:12:17,653 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:12:17,654 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-18 04:12:17,655 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,655 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-18 04:12:17,655 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43385,1689653423267' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-18 04:12:17,655 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-18 04:12:17,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,655 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-18 04:12:17,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-18 04:12:17,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,655 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-18 04:12:17,655 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,656 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-18 04:12:17,656 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:12:17,658 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-18 04:12:17,658 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,658 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-18 04:12:17,658 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-18 04:12:17,658 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:12:17,658 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35525,1689653423141' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-18 04:12:17,659 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-18 04:12:17,659 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-18 04:12:17,659 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42889,1689653423206' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-18 04:12:17,661 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,662 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,662 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:17,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:17,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:12:17,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:12:17,664 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:12:17,664 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,664 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:12:17,664 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:17,664 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,664 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:12:17,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:12:17,664 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,664 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:12:17,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:17,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:17,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:17,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:12:17,666 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43385,1689653423267' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-18 04:12:17,666 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5dae140f[Count = 1] remaining members to acquire global barrier 2023-07-18 04:12:17,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:17,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:12:17,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:12:17,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:12:17,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:12:17,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:17,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:17,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:17,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:12:17,672 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35525,1689653423141' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-18 04:12:17,672 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5dae140f[Count = 0] remaining members to acquire global barrier 2023-07-18 04:12:17,672 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-18 04:12:17,672 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,673 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,673 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,673 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,674 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:17,674 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-18 04:12:17,674 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-18 04:12:17,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,674 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-18 04:12:17,674 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42889,1689653423206' in zk 2023-07-18 04:12:17,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,674 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:12:17,674 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:12:17,674 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689653536953.ef94f9b8efbe86ebbe1257ed58925d0a. 2023-07-18 04:12:17,675 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689653536953.ef94f9b8efbe86ebbe1257ed58925d0a. started... 2023-07-18 04:12:17,675 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ef94f9b8efbe86ebbe1257ed58925d0a: 2023-07-18 04:12:17,675 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689653536953.ef94f9b8efbe86ebbe1257ed58925d0a.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,675 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:12:17,675 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 04:12:17,677 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:17,677 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 04:12:17,678 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-18 04:12:17,678 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:12:17,679 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-18 04:12:17,680 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-18 04:12:17,684 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:12:17,684 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689653536953.08bd493c16381be9c1011131de8722b7. 2023-07-18 04:12:17,684 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:12:17,684 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689653536953.08bd493c16381be9c1011131de8722b7. started... 2023-07-18 04:12:17,686 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 08bd493c16381be9c1011131de8722b7: 2023-07-18 04:12:17,686 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689653536953.08bd493c16381be9c1011131de8722b7.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,686 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:12:17,686 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 04:12:17,707 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689653536953.ef94f9b8efbe86ebbe1257ed58925d0a. completed. 2023-07-18 04:12:17,707 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689653536953.ef94f9b8efbe86ebbe1257ed58925d0a. 2023-07-18 04:12:17,707 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:12:17,707 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:12:17,707 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:17,707 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-18 04:12:17,707 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43385,1689653423267' in zk 2023-07-18 04:12:17,714 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-18 04:12:17,714 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:17,714 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:12:17,714 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-18 04:12:17,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:17,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:12:17,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:12:17,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:12:17,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:12:17,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:17,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:17,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:17,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:12:17,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:17,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:17,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43385,1689653423267': 2023-07-18 04:12:17,718 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43385,1689653423267' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-18 04:12:17,724 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:12:17,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-18 04:12:17,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:12:17,725 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 04:12:17,749 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689653536953.08bd493c16381be9c1011131de8722b7. completed. 2023-07-18 04:12:17,749 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689653536953.08bd493c16381be9c1011131de8722b7. 2023-07-18 04:12:17,749 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:12:17,749 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:12:17,749 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:17,749 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-18 04:12:17,749 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35525,1689653423141' in zk 2023-07-18 04:12:17,754 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:17,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:17,754 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-18 04:12:17,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:12:17,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:12:17,754 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:12:17,754 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-18 04:12:17,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:12:17,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:12:17,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:17,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:17,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:17,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:12:17,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:17,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:17,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:17,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35525,1689653423141': 2023-07-18 04:12:17,762 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35525,1689653423141' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-18 04:12:17,762 INFO [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-18 04:12:17,762 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 04:12:17,762 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 04:12:17,762 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,762 INFO [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 04:12:17,765 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,765 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,765 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:17,765 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,765 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,765 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:17,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:17,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:17,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:12:17,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:12:17,765 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:17,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:17,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:17,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:12:17,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:17,766 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:17,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:17,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,767 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:17,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:12:17,767 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:17,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:17,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:17,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:17,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:12:17,769 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:17,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,770 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:17,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:17,772 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:17,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:17,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:17,776 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:17,776 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:17,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:17,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:17,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:17,776 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:17,776 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:17,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:17,777 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:12:17,777 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,777 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,777 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,777 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-18 04:12:17,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:17,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:17,779 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:17,779 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:17,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:17,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:17,779 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,780 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-18 04:12:17,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:17,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:17,779 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:17,780 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:17,780 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:17,780 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:17,780 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:17,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:17,780 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,780 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:17,780 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:17,780 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,780 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,804 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,805 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,849 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,890 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-18 04:12:17,890 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,890 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,890 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689653537622Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689653537804 (+182 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689653537804Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689653537804Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689653537817 (+13 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689653537843 (+26 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689653537890 (+47 ms) 2023-07-18 04:12:17,893 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-18 04:12:17,894 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 270 msec 2023-07-18 04:12:17,925 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:12:17,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-18 04:12:17,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 04:12:17,930 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43385] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689653536953.ef94f9b8efbe86ebbe1257ed58925d0a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 04:12:17,930 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35525] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689653536953.08bd493c16381be9c1011131de8722b7. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 04:12:17,933 DEBUG [Listener at jenkins-hbase4.apache.org/40435] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,934 DEBUG [Listener at jenkins-hbase4.apache.org/40435] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689653536953.ef94f9b8efbe86ebbe1257ed58925d0a. 2023-07-18 04:12:17,934 INFO [Listener at jenkins-hbase4.apache.org/40435] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 04:12:17,948 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-18 04:12:17,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689653537949 (current time:1689653537949). 2023-07-18 04:12:17,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 04:12:17,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(139): Connect 0x0ab4990e to 127.0.0.1:64260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:12:17,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b108adb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:12:17,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:12:17,961 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42144, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:12:17,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0ab4990e to 127.0.0.1:64260 2023-07-18 04:12:17,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:12:17,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(139): Connect 0x3c4c28a8 to 127.0.0.1:64260 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 04:12:17,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@129ebac6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 04:12:17,971 DEBUG [hconnection-0x4d87bc1c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:12:17,980 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42156, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:12:17,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 04:12:17,988 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41268, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 04:12:17,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c4c28a8 to 127.0.0.1:64260 2023-07-18 04:12:17,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:12:17,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-18 04:12:17,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 04:12:17,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-18 04:12:17,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-18 04:12:17,994 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-18 04:12:17,994 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689654137994 2023-07-18 04:12:17,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-18 04:12:17,994 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:17,995 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 04:12:17,996 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 04:12:17,996 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-18 04:12:17,997 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-18 04:12:17,997 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-07-18 04:12:17,998 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-18 04:12:17,999 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689654137999 2023-07-18 04:12:18,010 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,011 INFO [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-18 04:12:18,011 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:12:18,012 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-18 04:12:18,012 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-18 04:12:18,012 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,012 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,014 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:18,014 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:18,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:18,014 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:18,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:18,014 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:18,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:18,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:18,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:18,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:18,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,014 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:18,015 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:18,015 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,015 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:18,015 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 04:12:18,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-18 04:12:18,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,015 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,016 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-18 04:12:18,016 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,016 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-18 04:12:18,016 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-18 04:12:18,016 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:12:18,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,017 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-18 04:12:18,017 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-18 04:12:18,018 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42889,1689653423206' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-18 04:12:18,018 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-18 04:12:18,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-18 04:12:18,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,018 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,018 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-18 04:12:18,018 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-18 04:12:18,018 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:12:18,019 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-18 04:12:18,019 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,019 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-18 04:12:18,019 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-18 04:12:18,019 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 04:12:18,019 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43385,1689653423267' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-18 04:12:18,021 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-18 04:12:18,021 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-18 04:12:18,021 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35525,1689653423141' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-18 04:12:18,025 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,026 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:18,026 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:18,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:12:18,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:12:18,026 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,027 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:12:18,026 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:18,027 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,026 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,027 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:12:18,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:12:18,027 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,027 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 04:12:18,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:12:18,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:18,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:18,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:18,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:12:18,029 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35525,1689653423141' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-18 04:12:18,029 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@357cc48c[Count = 1] remaining members to acquire global barrier 2023-07-18 04:12:18,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:18,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:12:18,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:12:18,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:12:18,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:12:18,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:18,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:18,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:18,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:12:18,031 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43385,1689653423267' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-18 04:12:18,031 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@357cc48c[Count = 0] remaining members to acquire global barrier 2023-07-18 04:12:18,031 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-18 04:12:18,032 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,037 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,037 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,037 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,038 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-18 04:12:18,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,038 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-18 04:12:18,038 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-18 04:12:18,038 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-18 04:12:18,038 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42889,1689653423206' in zk 2023-07-18 04:12:18,038 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:12:18,038 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:12:18,038 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 04:12:18,038 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 04:12:18,038 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:18,038 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689653536953.08bd493c16381be9c1011131de8722b7. 2023-07-18 04:12:18,038 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689653536953.ef94f9b8efbe86ebbe1257ed58925d0a. 2023-07-18 04:12:18,038 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689653536953.08bd493c16381be9c1011131de8722b7. started... 2023-07-18 04:12:18,038 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689653536953.ef94f9b8efbe86ebbe1257ed58925d0a. started... 2023-07-18 04:12:18,039 INFO [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ef94f9b8efbe86ebbe1257ed58925d0a 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-18 04:12:18,039 INFO [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 08bd493c16381be9c1011131de8722b7 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-18 04:12:18,039 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:18,039 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 04:12:18,040 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-18 04:12:18,040 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:12:18,040 DEBUG [member: 'jenkins-hbase4.apache.org,42889,1689653423206' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-18 04:12:18,059 INFO [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230718064323cafd2e440787f042258edf6b3b to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230718064323cafd2e440787f042258edf6b3b 2023-07-18 04:12:18,059 INFO [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071895d5e168046d4969b4d759d3e076e893 to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023071895d5e168046d4969b4d759d3e076e893 2023-07-18 04:12:18,073 INFO [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef94f9b8efbe86ebbe1257ed58925d0a/.tmp/cf/15f8add80bff4a37913b512bb8880b19 2023-07-18 04:12:18,075 INFO [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithSkipTmp/08bd493c16381be9c1011131de8722b7/.tmp/cf/a99c1ebed6804a4893be3b19db19155d 2023-07-18 04:12:18,079 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef94f9b8efbe86ebbe1257ed58925d0a/.tmp/cf/15f8add80bff4a37913b512bb8880b19 as hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef94f9b8efbe86ebbe1257ed58925d0a/cf/15f8add80bff4a37913b512bb8880b19 2023-07-18 04:12:18,080 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithSkipTmp/08bd493c16381be9c1011131de8722b7/.tmp/cf/a99c1ebed6804a4893be3b19db19155d as hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithSkipTmp/08bd493c16381be9c1011131de8722b7/cf/a99c1ebed6804a4893be3b19db19155d 2023-07-18 04:12:18,083 INFO [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef94f9b8efbe86ebbe1257ed58925d0a/cf/15f8add80bff4a37913b512bb8880b19, entries=2, sequenceid=6, filesize=5.2 K 2023-07-18 04:12:18,084 INFO [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for ef94f9b8efbe86ebbe1257ed58925d0a in 45ms, sequenceid=6, compaction requested=false 2023-07-18 04:12:18,084 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-18 04:12:18,084 INFO [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithSkipTmp/08bd493c16381be9c1011131de8722b7/cf/a99c1ebed6804a4893be3b19db19155d, entries=48, sequenceid=6, filesize=13.5 K 2023-07-18 04:12:18,084 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ef94f9b8efbe86ebbe1257ed58925d0a: 2023-07-18 04:12:18,084 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689653536953.ef94f9b8efbe86ebbe1257ed58925d0a.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,085 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:12:18,085 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef94f9b8efbe86ebbe1257ed58925d0a/cf/15f8add80bff4a37913b512bb8880b19] hfiles 2023-07-18 04:12:18,085 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef94f9b8efbe86ebbe1257ed58925d0a/cf/15f8add80bff4a37913b512bb8880b19 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,085 INFO [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 08bd493c16381be9c1011131de8722b7 in 46ms, sequenceid=6, compaction requested=false 2023-07-18 04:12:18,087 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 08bd493c16381be9c1011131de8722b7: 2023-07-18 04:12:18,087 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689653536953.08bd493c16381be9c1011131de8722b7.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,087 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 04:12:18,087 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithSkipTmp/08bd493c16381be9c1011131de8722b7/cf/a99c1ebed6804a4893be3b19db19155d] hfiles 2023-07-18 04:12:18,087 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithSkipTmp/08bd493c16381be9c1011131de8722b7/cf/a99c1ebed6804a4893be3b19db19155d for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,096 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:12:18,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-18 04:12:18,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-18 04:12:18,097 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 04:12:18,099 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689653536953.08bd493c16381be9c1011131de8722b7. completed. 2023-07-18 04:12:18,099 DEBUG [rs(jenkins-hbase4.apache.org,35525,1689653423141)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689653536953.08bd493c16381be9c1011131de8722b7. 2023-07-18 04:12:18,099 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:12:18,099 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:12:18,099 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:18,099 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-18 04:12:18,099 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35525,1689653423141' in zk 2023-07-18 04:12:18,101 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-18 04:12:18,101 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:12:18,101 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:18,101 DEBUG [member: 'jenkins-hbase4.apache.org,35525,1689653423141' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-18 04:12:18,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:18,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:12:18,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:12:18,103 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689653536953.ef94f9b8efbe86ebbe1257ed58925d0a. completed. 2023-07-18 04:12:18,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:12:18,103 DEBUG [rs(jenkins-hbase4.apache.org,43385,1689653423267)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689653536953.ef94f9b8efbe86ebbe1257ed58925d0a. 2023-07-18 04:12:18,103 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 04:12:18,103 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 04:12:18,103 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:18,103 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-18 04:12:18,103 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43385,1689653423267' in zk 2023-07-18 04:12:18,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:12:18,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,106 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:18,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:18,106 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-18 04:12:18,106 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:12:18,106 DEBUG [member: 'jenkins-hbase4.apache.org,43385,1689653423267' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-18 04:12:18,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:18,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:18,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:12:18,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:18,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:18,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:18,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35525,1689653423141': 2023-07-18 04:12:18,110 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35525,1689653423141' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-18 04:12:18,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:18,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:12:18,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:12:18,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:12:18,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:12:18,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:18,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:18,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:18,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:12:18,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:18,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:18,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:18,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43385,1689653423267': 2023-07-18 04:12:18,113 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43385,1689653423267' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-18 04:12:18,113 INFO [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-18 04:12:18,113 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 04:12:18,113 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 04:12:18,113 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,113 INFO [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 04:12:18,115 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,115 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,115 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,115 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:18,115 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,115 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:18,115 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:18,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 04:12:18,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 04:12:18,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:18,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:18,115 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:18,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:18,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:18,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:18,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 04:12:18,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:18,116 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:18,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,116 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:18,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 04:12:18,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:18,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:18,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:18,118 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:18,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 04:12:18,118 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:18,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,119 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:18,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:18,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:18,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:18,121 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:18,121 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,121 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:18,121 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:18,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:18,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:18,121 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:18,121 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,122 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:18,122 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,122 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:18,122 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:12:18,122 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,122 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,121 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:18,121 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 04:12:18,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:18,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:18,121 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:18,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 04:12:18,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 04:12:18,122 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,122 DEBUG [(jenkins-hbase4.apache.org,46231,1689653421609)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 04:12:18,122 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:18,122 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:18,124 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:18,124 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-18 04:12:18,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:18,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:18,124 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 04:12:18,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 04:12:18,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 04:12:18,125 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023071895d5e168046d4969b4d759d3e076e893, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230718064323cafd2e440787f042258edf6b3b] mob files 2023-07-18 04:12:18,125 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023071895d5e168046d4969b4d759d3e076e893 2023-07-18 04:12:18,125 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230718064323cafd2e440787f042258edf6b3b 2023-07-18 04:12:18,152 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,152 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,195 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,219 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-18 04:12:18,219 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,219 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,219 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689653537994Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689653538152 (+158 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689653538152Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689653538152Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689653538164 (+12 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689653538188 (+24 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689653538219 (+31 ms) 2023-07-18 04:12:18,222 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-18 04:12:18,224 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 228 msec 2023-07-18 04:12:18,297 DEBUG [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 04:12:18,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-18 04:12:18,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 04:12:18,299 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653538299 2023-07-18 04:12:18,299 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43229, tgtDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653538299, rawTgtDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653538299, srcFsUri=hdfs://localhost:43229, srcDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8 2023-07-18 04:12:18,330 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43229, inputRoot=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8 2023-07-18 04:12:18,331 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1730537511_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653538299, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653538299/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,331 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43229, inputRoot=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8, snapshotDir=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-18 04:12:18,372 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653538299/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:18,434 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:18,435 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:18,435 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:18,436 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:18,436 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:18,437 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:18,437 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:18,541 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/hadoop-1271630729823410535.jar 2023-07-18 04:12:18,542 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:18,542 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:18,543 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:18,543 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:18,544 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:18,545 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 04:12:18,545 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 04:12:18,546 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 04:12:18,546 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 04:12:18,547 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 04:12:18,547 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 04:12:18,548 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 04:12:18,549 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 04:12:18,549 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 04:12:18,549 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 04:12:18,550 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 04:12:18,550 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:12:18,551 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:12:18,551 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 04:12:18,551 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:12:18,552 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 04:12:18,552 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 04:12:18,553 DEBUG [Listener at jenkins-hbase4.apache.org/40435] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 04:12:19,503 WARN [Listener at jenkins-hbase4.apache.org/40435] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 04:12:19,505 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-18 04:12:19,507 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-18 04:12:20,888 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 04:12:20,889 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 04:12:20,891 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653430729_0006_000001 (auth:SIMPLE) 2023-07-18 04:12:20,976 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653430729_0007_000001 (auth:SIMPLE) 2023-07-18 04:12:22,240 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 04:12:26,525 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653430729_0007_000001 (auth:SIMPLE) 2023-07-18 04:12:28,845 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653430729_0007_000001 (auth:SIMPLE) 2023-07-18 04:12:33,919 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653430729_0007_000001 (auth:SIMPLE) 2023-07-18 04:12:35,280 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 04:12:35,280 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 04:12:35,325 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:35,326 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 04:12:35,327 INFO [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 04:12:35,327 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-559505343_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:35,328 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(367): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-18 04:12:35,328 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(367): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-18 04:12:35,328 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-559505343_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653538299/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653538299/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:35,329 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(367): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653538299/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-18 04:12:35,329 DEBUG [Listener at jenkins-hbase4.apache.org/40435] snapshot.TestExportSnapshot(367): hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/export-test/export-1689653538299/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-18 04:12:35,340 INFO [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:35,341 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:35,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:35,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-18 04:12:35,346 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653555346"}]},"ts":"1689653555346"} 2023-07-18 04:12:35,348 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-18 04:12:35,349 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-18 04:12:35,351 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ef94f9b8efbe86ebbe1257ed58925d0a, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=08bd493c16381be9c1011131de8722b7, UNASSIGN}] 2023-07-18 04:12:35,353 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ef94f9b8efbe86ebbe1257ed58925d0a, UNASSIGN 2023-07-18 04:12:35,353 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=08bd493c16381be9c1011131de8722b7, UNASSIGN 2023-07-18 04:12:35,354 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=ef94f9b8efbe86ebbe1257ed58925d0a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:12:35,355 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=08bd493c16381be9c1011131de8722b7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:12:35,355 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689653536953.ef94f9b8efbe86ebbe1257ed58925d0a.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689653555354"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653555354"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653555354"}]},"ts":"1689653555354"} 2023-07-18 04:12:35,355 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689653536953.08bd493c16381be9c1011131de8722b7.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689653555355"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689653555355"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689653555355"}]},"ts":"1689653555355"} 2023-07-18 04:12:35,358 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure ef94f9b8efbe86ebbe1257ed58925d0a, server=jenkins-hbase4.apache.org,43385,1689653423267}] 2023-07-18 04:12:35,359 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 08bd493c16381be9c1011131de8722b7, server=jenkins-hbase4.apache.org,35525,1689653423141}] 2023-07-18 04:12:35,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-18 04:12:35,515 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 08bd493c16381be9c1011131de8722b7 2023-07-18 04:12:35,515 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ef94f9b8efbe86ebbe1257ed58925d0a 2023-07-18 04:12:35,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 08bd493c16381be9c1011131de8722b7, disabling compactions & flushes 2023-07-18 04:12:35,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ef94f9b8efbe86ebbe1257ed58925d0a, disabling compactions & flushes 2023-07-18 04:12:35,515 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689653536953.08bd493c16381be9c1011131de8722b7. 2023-07-18 04:12:35,515 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689653536953.ef94f9b8efbe86ebbe1257ed58925d0a. 2023-07-18 04:12:35,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689653536953.08bd493c16381be9c1011131de8722b7. 2023-07-18 04:12:35,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689653536953.ef94f9b8efbe86ebbe1257ed58925d0a. 2023-07-18 04:12:35,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689653536953.08bd493c16381be9c1011131de8722b7. after waiting 0 ms 2023-07-18 04:12:35,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689653536953.08bd493c16381be9c1011131de8722b7. 2023-07-18 04:12:35,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689653536953.ef94f9b8efbe86ebbe1257ed58925d0a. after waiting 0 ms 2023-07-18 04:12:35,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689653536953.ef94f9b8efbe86ebbe1257ed58925d0a. 2023-07-18 04:12:35,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef94f9b8efbe86ebbe1257ed58925d0a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 04:12:35,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:12:35,529 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689653536953.ef94f9b8efbe86ebbe1257ed58925d0a. 2023-07-18 04:12:35,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ef94f9b8efbe86ebbe1257ed58925d0a: 2023-07-18 04:12:35,532 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ef94f9b8efbe86ebbe1257ed58925d0a 2023-07-18 04:12:35,532 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=ef94f9b8efbe86ebbe1257ed58925d0a, regionState=CLOSED 2023-07-18 04:12:35,532 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689653536953.ef94f9b8efbe86ebbe1257ed58925d0a.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689653555532"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653555532"}]},"ts":"1689653555532"} 2023-07-18 04:12:35,541 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-18 04:12:35,541 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure ef94f9b8efbe86ebbe1257ed58925d0a, server=jenkins-hbase4.apache.org,43385,1689653423267 in 177 msec 2023-07-18 04:12:35,543 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ef94f9b8efbe86ebbe1257ed58925d0a, UNASSIGN in 191 msec 2023-07-18 04:12:35,547 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/default/testtb-testExportFileSystemStateWithSkipTmp/08bd493c16381be9c1011131de8722b7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 04:12:35,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:12:35,550 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689653536953.08bd493c16381be9c1011131de8722b7. 2023-07-18 04:12:35,550 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 08bd493c16381be9c1011131de8722b7: 2023-07-18 04:12:35,554 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 08bd493c16381be9c1011131de8722b7 2023-07-18 04:12:35,554 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=08bd493c16381be9c1011131de8722b7, regionState=CLOSED 2023-07-18 04:12:35,554 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689653536953.08bd493c16381be9c1011131de8722b7.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689653555554"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689653555554"}]},"ts":"1689653555554"} 2023-07-18 04:12:35,559 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-18 04:12:35,559 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 08bd493c16381be9c1011131de8722b7, server=jenkins-hbase4.apache.org,35525,1689653423141 in 197 msec 2023-07-18 04:12:35,561 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-18 04:12:35,562 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=08bd493c16381be9c1011131de8722b7, UNASSIGN in 208 msec 2023-07-18 04:12:35,563 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689653555563"}]},"ts":"1689653555563"} 2023-07-18 04:12:35,567 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-18 04:12:35,569 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-18 04:12:35,572 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 229 msec 2023-07-18 04:12:35,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-18 04:12:35,653 INFO [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-18 04:12:35,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:35,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:35,658 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:35,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:35,662 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:35,663 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35525] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:35,667 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:35,668 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:35,669 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:35,669 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:35,669 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-18 04:12:35,670 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-18 04:12:35,670 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-18 04:12:35,670 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-18 04:12:35,672 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:35,672 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:35,672 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:35,672 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:35,672 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:35,672 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:35,673 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:35,673 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 04:12:35,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-18 04:12:35,674 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/08bd493c16381be9c1011131de8722b7 2023-07-18 04:12:35,675 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef94f9b8efbe86ebbe1257ed58925d0a 2023-07-18 04:12:35,678 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/08bd493c16381be9c1011131de8722b7/cf, FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/08bd493c16381be9c1011131de8722b7/recovered.edits] 2023-07-18 04:12:35,678 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef94f9b8efbe86ebbe1257ed58925d0a/cf, FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef94f9b8efbe86ebbe1257ed58925d0a/recovered.edits] 2023-07-18 04:12:35,683 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/08bd493c16381be9c1011131de8722b7/cf/a99c1ebed6804a4893be3b19db19155d to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/08bd493c16381be9c1011131de8722b7/cf/a99c1ebed6804a4893be3b19db19155d 2023-07-18 04:12:35,687 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/08bd493c16381be9c1011131de8722b7/recovered.edits/9.seqid to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/08bd493c16381be9c1011131de8722b7/recovered.edits/9.seqid 2023-07-18 04:12:35,688 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/08bd493c16381be9c1011131de8722b7 2023-07-18 04:12:35,690 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef94f9b8efbe86ebbe1257ed58925d0a/cf/15f8add80bff4a37913b512bb8880b19 to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef94f9b8efbe86ebbe1257ed58925d0a/cf/15f8add80bff4a37913b512bb8880b19 2023-07-18 04:12:35,695 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef94f9b8efbe86ebbe1257ed58925d0a/recovered.edits/9.seqid to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef94f9b8efbe86ebbe1257ed58925d0a/recovered.edits/9.seqid 2023-07-18 04:12:35,695 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ef94f9b8efbe86ebbe1257ed58925d0a 2023-07-18 04:12:35,695 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-18 04:12:35,696 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-18 04:12:35,697 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-18 04:12:35,701 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023071895d5e168046d4969b4d759d3e076e893 to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023071895d5e168046d4969b4d759d3e076e893 2023-07-18 04:12:35,702 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230718064323cafd2e440787f042258edf6b3b to hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230718064323cafd2e440787f042258edf6b3b 2023-07-18 04:12:35,703 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-18 04:12:35,705 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:35,707 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-18 04:12:35,709 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-18 04:12:35,710 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:35,710 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-18 04:12:35,711 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689653536953.ef94f9b8efbe86ebbe1257ed58925d0a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689653555710"}]},"ts":"9223372036854775807"} 2023-07-18 04:12:35,711 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689653536953.08bd493c16381be9c1011131de8722b7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689653555710"}]},"ts":"9223372036854775807"} 2023-07-18 04:12:35,716 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-18 04:12:35,716 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ef94f9b8efbe86ebbe1257ed58925d0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689653536953.ef94f9b8efbe86ebbe1257ed58925d0a.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 08bd493c16381be9c1011131de8722b7, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689653536953.08bd493c16381be9c1011131de8722b7.', STARTKEY => '1', ENDKEY => ''}] 2023-07-18 04:12:35,716 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-18 04:12:35,716 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689653555716"}]},"ts":"9223372036854775807"} 2023-07-18 04:12:35,717 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-18 04:12:35,719 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:35,720 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 65 msec 2023-07-18 04:12:35,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-18 04:12:35,776 INFO [Listener at jenkins-hbase4.apache.org/40435] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-18 04:12:35,785 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-18 04:12:35,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:35,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-18 04:12:35,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 04:12:35,829 INFO [Listener at jenkins-hbase4.apache.org/40435] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764 (was 762) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-559505343_17 at /127.0.0.1:37808 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5658 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1966361669) connection to jenkins-hbase4.apache.org/172.31.14.131:38121 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0xf2856f0-shared-pool-46 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xf2856f0-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-559505343_17 at /127.0.0.1:42862 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-559505343_17 at /127.0.0.1:38618 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1455128862_1 at /127.0.0.1:38588 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xf2856f0-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xf2856f0-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=915 (was 928), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=671 (was 488) - SystemLoadAverage LEAK? -, ProcessCount=186 (was 183) - ProcessCount LEAK? -, AvailableMemoryMB=760 (was 1766) 2023-07-18 04:12:35,829 WARN [Listener at jenkins-hbase4.apache.org/40435] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-18 04:12:35,829 INFO [Listener at jenkins-hbase4.apache.org/40435] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-18 04:12:35,841 INFO [Listener at jenkins-hbase4.apache.org/40435] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-18 04:12:40,149 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689653430729_0007_000001 (auth:SIMPLE) 2023-07-18 04:12:41,120 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 04:12:49,872 INFO [Listener at jenkins-hbase4.apache.org/40435] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-18 04:13:03,995 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-18 04:13:03,996 INFO [Listener at jenkins-hbase4.apache.org/40435] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-18 04:13:04,108 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-18 04:13:04,123 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-18 04:13:04,124 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-18 04:13:04,142 INFO [Listener at jenkins-hbase4.apache.org/40435] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-18 04:13:04,246 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-18 04:13:04,246 INFO [Listener at jenkins-hbase4.apache.org/40435] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-18 04:13:04,246 INFO [Listener at jenkins-hbase4.apache.org/40435] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-18 04:13:04,247 INFO [Listener at jenkins-hbase4.apache.org/40435] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-18 04:13:04,247 DEBUG [Listener at jenkins-hbase4.apache.org/40435] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4cd4fb6c to 127.0.0.1:64260 2023-07-18 04:13:04,247 DEBUG [Listener at jenkins-hbase4.apache.org/40435] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:13:04,247 DEBUG [Listener at jenkins-hbase4.apache.org/40435] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-18 04:13:04,247 DEBUG [Listener at jenkins-hbase4.apache.org/40435] util.JVMClusterUtil(257): Found active master hash=1501239114, stopped=false 2023-07-18 04:13:04,247 DEBUG [Listener at jenkins-hbase4.apache.org/40435] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:13:04,247 DEBUG [Listener at jenkins-hbase4.apache.org/40435] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-18 04:13:04,248 INFO [Listener at jenkins-hbase4.apache.org/40435] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,46231,1689653421609 2023-07-18 04:13:04,249 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-18 04:13:04,249 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-18 04:13:04,249 INFO [Listener at jenkins-hbase4.apache.org/40435] procedure2.ProcedureExecutor(629): Stopping 2023-07-18 04:13:04,249 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-18 04:13:04,249 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-18 04:13:04,249 DEBUG [Listener at jenkins-hbase4.apache.org/40435] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ef6ca3b to 127.0.0.1:64260 2023-07-18 04:13:04,249 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 04:13:04,249 DEBUG [Listener at jenkins-hbase4.apache.org/40435] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:13:04,250 INFO [Listener at jenkins-hbase4.apache.org/40435] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,35525,1689653423141' ***** 2023-07-18 04:13:04,250 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 04:13:04,250 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 04:13:04,250 DEBUG [Listener at jenkins-hbase4.apache.org/40435] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:13:04,250 INFO [Listener at jenkins-hbase4.apache.org/40435] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-18 04:13:04,250 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 04:13:04,250 INFO [RS:0;jenkins-hbase4:35525] regionserver.HeapMemoryManager(220): Stopping 2023-07-18 04:13:04,250 INFO [Listener at jenkins-hbase4.apache.org/40435] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42889,1689653423206' ***** 2023-07-18 04:13:04,251 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 04:13:04,251 DEBUG [Listener at jenkins-hbase4.apache.org/40435] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:13:04,251 INFO [Listener at jenkins-hbase4.apache.org/40435] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-18 04:13:04,251 INFO [Listener at jenkins-hbase4.apache.org/40435] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43385,1689653423267' ***** 2023-07-18 04:13:04,251 DEBUG [Listener at jenkins-hbase4.apache.org/40435] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:13:04,251 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-18 04:13:04,251 INFO [RS:1;jenkins-hbase4:42889] regionserver.HeapMemoryManager(220): Stopping 2023-07-18 04:13:04,251 INFO [RS:1;jenkins-hbase4:42889] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-18 04:13:04,251 INFO [RS:1;jenkins-hbase4:42889] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-18 04:13:04,251 INFO [RS:1;jenkins-hbase4:42889] regionserver.HRegionServer(3305): Received CLOSE for 104dd5cf9dea83884c2dad25eb49b80e 2023-07-18 04:13:04,252 INFO [RS:1;jenkins-hbase4:42889] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:13:04,252 DEBUG [RS:1;jenkins-hbase4:42889] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x342c7858 to 127.0.0.1:64260 2023-07-18 04:13:04,252 DEBUG [RS:1;jenkins-hbase4:42889] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:13:04,251 INFO [RS:0;jenkins-hbase4:35525] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-18 04:13:04,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 104dd5cf9dea83884c2dad25eb49b80e, disabling compactions & flushes 2023-07-18 04:13:04,251 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-18 04:13:04,255 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689653426068.104dd5cf9dea83884c2dad25eb49b80e. 2023-07-18 04:13:04,251 INFO [Listener at jenkins-hbase4.apache.org/40435] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-18 04:13:04,255 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689653426068.104dd5cf9dea83884c2dad25eb49b80e. 2023-07-18 04:13:04,255 INFO [RS:0;jenkins-hbase4:35525] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-18 04:13:04,255 INFO [RS:1;jenkins-hbase4:42889] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-18 04:13:04,256 INFO [RS:2;jenkins-hbase4:43385] regionserver.HeapMemoryManager(220): Stopping 2023-07-18 04:13:04,256 INFO [RS:0;jenkins-hbase4:35525] regionserver.HRegionServer(3305): Received CLOSE for c19f69e100a1c0c78ad29cf77fb8f117 2023-07-18 04:13:04,256 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-18 04:13:04,256 INFO [RS:0;jenkins-hbase4:35525] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:13:04,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689653426068.104dd5cf9dea83884c2dad25eb49b80e. after waiting 0 ms 2023-07-18 04:13:04,256 DEBUG [RS:0;jenkins-hbase4:35525] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x03396479 to 127.0.0.1:64260 2023-07-18 04:13:04,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c19f69e100a1c0c78ad29cf77fb8f117, disabling compactions & flushes 2023-07-18 04:13:04,256 DEBUG [RS:0;jenkins-hbase4:35525] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:13:04,257 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689653426966.c19f69e100a1c0c78ad29cf77fb8f117. 2023-07-18 04:13:04,257 INFO [RS:0;jenkins-hbase4:35525] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-18 04:13:04,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689653426068.104dd5cf9dea83884c2dad25eb49b80e. 2023-07-18 04:13:04,256 INFO [RS:2;jenkins-hbase4:43385] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-18 04:13:04,256 DEBUG [RS:1;jenkins-hbase4:42889] regionserver.HRegionServer(1478): Online Regions={104dd5cf9dea83884c2dad25eb49b80e=hbase:namespace,,1689653426068.104dd5cf9dea83884c2dad25eb49b80e.} 2023-07-18 04:13:04,257 INFO [RS:2;jenkins-hbase4:43385] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-18 04:13:04,257 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 104dd5cf9dea83884c2dad25eb49b80e 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-18 04:13:04,257 DEBUG [RS:0;jenkins-hbase4:35525] regionserver.HRegionServer(1478): Online Regions={c19f69e100a1c0c78ad29cf77fb8f117=hbase:acl,,1689653426966.c19f69e100a1c0c78ad29cf77fb8f117.} 2023-07-18 04:13:04,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689653426966.c19f69e100a1c0c78ad29cf77fb8f117. 2023-07-18 04:13:04,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689653426966.c19f69e100a1c0c78ad29cf77fb8f117. after waiting 0 ms 2023-07-18 04:13:04,258 DEBUG [RS:1;jenkins-hbase4:42889] regionserver.HRegionServer(1504): Waiting on 104dd5cf9dea83884c2dad25eb49b80e 2023-07-18 04:13:04,257 INFO [RS:2;jenkins-hbase4:43385] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:13:04,258 DEBUG [RS:0;jenkins-hbase4:35525] regionserver.HRegionServer(1504): Waiting on c19f69e100a1c0c78ad29cf77fb8f117 2023-07-18 04:13:04,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689653426966.c19f69e100a1c0c78ad29cf77fb8f117. 2023-07-18 04:13:04,258 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing c19f69e100a1c0c78ad29cf77fb8f117 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-18 04:13:04,258 DEBUG [RS:2;jenkins-hbase4:43385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1fb3343b to 127.0.0.1:64260 2023-07-18 04:13:04,259 DEBUG [RS:2;jenkins-hbase4:43385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:13:04,259 INFO [RS:2;jenkins-hbase4:43385] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-18 04:13:04,259 INFO [RS:2;jenkins-hbase4:43385] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-18 04:13:04,260 INFO [RS:2;jenkins-hbase4:43385] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-18 04:13:04,260 INFO [RS:2;jenkins-hbase4:43385] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-18 04:13:04,261 INFO [RS:2;jenkins-hbase4:43385] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-18 04:13:04,261 DEBUG [RS:2;jenkins-hbase4:43385] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-18 04:13:04,261 DEBUG [RS:2;jenkins-hbase4:43385] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-18 04:13:04,262 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-18 04:13:04,262 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-18 04:13:04,262 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-18 04:13:04,262 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-18 04:13:04,262 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-18 04:13:04,262 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-18 04:13:04,300 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/namespace/104dd5cf9dea83884c2dad25eb49b80e/.tmp/info/f9a6ed28c29e46cd8215f252e89a5f4c 2023-07-18 04:13:04,303 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/meta/1588230740/.tmp/info/0d9a1a4bce88419f98bb2c18ebd1021d 2023-07-18 04:13:04,307 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/acl/c19f69e100a1c0c78ad29cf77fb8f117/.tmp/l/e25cfc65884f4bb996333df394a6029a 2023-07-18 04:13:04,309 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-18 04:13:04,317 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-18 04:13:04,319 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-18 04:13:04,319 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-18 04:13:04,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/namespace/104dd5cf9dea83884c2dad25eb49b80e/.tmp/info/f9a6ed28c29e46cd8215f252e89a5f4c as hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/namespace/104dd5cf9dea83884c2dad25eb49b80e/info/f9a6ed28c29e46cd8215f252e89a5f4c 2023-07-18 04:13:04,325 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0d9a1a4bce88419f98bb2c18ebd1021d 2023-07-18 04:13:04,330 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/namespace/104dd5cf9dea83884c2dad25eb49b80e/info/f9a6ed28c29e46cd8215f252e89a5f4c, entries=2, sequenceid=6, filesize=4.8 K 2023-07-18 04:13:04,331 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e25cfc65884f4bb996333df394a6029a 2023-07-18 04:13:04,331 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 104dd5cf9dea83884c2dad25eb49b80e in 74ms, sequenceid=6, compaction requested=false 2023-07-18 04:13:04,334 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-18 04:13:04,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/acl/c19f69e100a1c0c78ad29cf77fb8f117/.tmp/l/e25cfc65884f4bb996333df394a6029a as hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/acl/c19f69e100a1c0c78ad29cf77fb8f117/l/e25cfc65884f4bb996333df394a6029a 2023-07-18 04:13:04,350 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e25cfc65884f4bb996333df394a6029a 2023-07-18 04:13:04,350 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/acl/c19f69e100a1c0c78ad29cf77fb8f117/l/e25cfc65884f4bb996333df394a6029a, entries=7, sequenceid=18, filesize=5.2 K 2023-07-18 04:13:04,351 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for c19f69e100a1c0c78ad29cf77fb8f117 in 93ms, sequenceid=18, compaction requested=false 2023-07-18 04:13:04,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/namespace/104dd5cf9dea83884c2dad25eb49b80e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 04:13:04,361 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/meta/1588230740/.tmp/rep_barrier/be61aa3d65c14cdaaa230f0bf6f8ba7f 2023-07-18 04:13:04,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:13:04,362 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689653426068.104dd5cf9dea83884c2dad25eb49b80e. 2023-07-18 04:13:04,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 104dd5cf9dea83884c2dad25eb49b80e: 2023-07-18 04:13:04,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689653426068.104dd5cf9dea83884c2dad25eb49b80e. 2023-07-18 04:13:04,366 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for be61aa3d65c14cdaaa230f0bf6f8ba7f 2023-07-18 04:13:04,373 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-18 04:13:04,373 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-18 04:13:04,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/acl/c19f69e100a1c0c78ad29cf77fb8f117/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-18 04:13:04,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:13:04,379 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689653426966.c19f69e100a1c0c78ad29cf77fb8f117. 2023-07-18 04:13:04,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c19f69e100a1c0c78ad29cf77fb8f117: 2023-07-18 04:13:04,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689653426966.c19f69e100a1c0c78ad29cf77fb8f117. 2023-07-18 04:13:04,385 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/meta/1588230740/.tmp/table/2d34acfad767400c8b19904926834487 2023-07-18 04:13:04,389 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2d34acfad767400c8b19904926834487 2023-07-18 04:13:04,389 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/meta/1588230740/.tmp/info/0d9a1a4bce88419f98bb2c18ebd1021d as hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/meta/1588230740/info/0d9a1a4bce88419f98bb2c18ebd1021d 2023-07-18 04:13:04,393 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0d9a1a4bce88419f98bb2c18ebd1021d 2023-07-18 04:13:04,394 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/meta/1588230740/info/0d9a1a4bce88419f98bb2c18ebd1021d, entries=48, sequenceid=131, filesize=10.3 K 2023-07-18 04:13:04,394 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-18 04:13:04,394 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-18 04:13:04,394 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/meta/1588230740/.tmp/rep_barrier/be61aa3d65c14cdaaa230f0bf6f8ba7f as hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/meta/1588230740/rep_barrier/be61aa3d65c14cdaaa230f0bf6f8ba7f 2023-07-18 04:13:04,399 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for be61aa3d65c14cdaaa230f0bf6f8ba7f 2023-07-18 04:13:04,399 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/meta/1588230740/rep_barrier/be61aa3d65c14cdaaa230f0bf6f8ba7f, entries=13, sequenceid=131, filesize=6.4 K 2023-07-18 04:13:04,400 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/meta/1588230740/.tmp/table/2d34acfad767400c8b19904926834487 as hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/meta/1588230740/table/2d34acfad767400c8b19904926834487 2023-07-18 04:13:04,404 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2d34acfad767400c8b19904926834487 2023-07-18 04:13:04,404 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/meta/1588230740/table/2d34acfad767400c8b19904926834487, entries=24, sequenceid=131, filesize=6.9 K 2023-07-18 04:13:04,405 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 143ms, sequenceid=131, compaction requested=false 2023-07-18 04:13:04,416 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-18 04:13:04,417 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 04:13:04,417 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-18 04:13:04,418 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-18 04:13:04,418 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-18 04:13:04,418 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-18 04:13:04,458 INFO [RS:1;jenkins-hbase4:42889] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42889,1689653423206; all regions closed. 2023-07-18 04:13:04,458 INFO [RS:0;jenkins-hbase4:35525] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,35525,1689653423141; all regions closed. 2023-07-18 04:13:04,461 INFO [RS:2;jenkins-hbase4:43385] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43385,1689653423267; all regions closed. 2023-07-18 04:13:04,473 DEBUG [RS:1;jenkins-hbase4:42889] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/oldWALs 2023-07-18 04:13:04,473 INFO [RS:1;jenkins-hbase4:42889] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42889%2C1689653423206:(num 1689653425551) 2023-07-18 04:13:04,473 DEBUG [RS:1;jenkins-hbase4:42889] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:13:04,473 DEBUG [RS:0;jenkins-hbase4:35525] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/oldWALs 2023-07-18 04:13:04,473 INFO [RS:1;jenkins-hbase4:42889] regionserver.LeaseManager(133): Closed leases 2023-07-18 04:13:04,473 INFO [RS:0;jenkins-hbase4:35525] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35525%2C1689653423141:(num 1689653425505) 2023-07-18 04:13:04,474 DEBUG [RS:0;jenkins-hbase4:35525] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:13:04,474 INFO [RS:0;jenkins-hbase4:35525] regionserver.LeaseManager(133): Closed leases 2023-07-18 04:13:04,474 INFO [RS:1;jenkins-hbase4:42889] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-18 04:13:04,474 INFO [RS:1;jenkins-hbase4:42889] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-18 04:13:04,474 INFO [RS:1;jenkins-hbase4:42889] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-18 04:13:04,474 INFO [RS:1;jenkins-hbase4:42889] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-18 04:13:04,474 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-18 04:13:04,475 INFO [RS:0;jenkins-hbase4:35525] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-18 04:13:04,477 DEBUG [RS:2;jenkins-hbase4:43385] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/oldWALs 2023-07-18 04:13:04,477 INFO [RS:2;jenkins-hbase4:43385] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43385%2C1689653423267.meta:.meta(num 1689653425722) 2023-07-18 04:13:04,479 INFO [RS:0;jenkins-hbase4:35525] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-18 04:13:04,479 INFO [RS:1;jenkins-hbase4:42889] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42889 2023-07-18 04:13:04,479 INFO [RS:0;jenkins-hbase4:35525] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-18 04:13:04,479 INFO [RS:0;jenkins-hbase4:35525] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-18 04:13:04,479 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-18 04:13:04,480 INFO [RS:0;jenkins-hbase4:35525] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35525 2023-07-18 04:13:04,490 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:13:04,490 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:13:04,490 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 04:13:04,490 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 04:13:04,490 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 04:13:04,490 DEBUG [RS:2;jenkins-hbase4:43385] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/oldWALs 2023-07-18 04:13:04,490 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35525,1689653423141 2023-07-18 04:13:04,491 INFO [RS:2;jenkins-hbase4:43385] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43385%2C1689653423267:(num 1689653425551) 2023-07-18 04:13:04,491 DEBUG [RS:2;jenkins-hbase4:43385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:13:04,491 INFO [RS:2;jenkins-hbase4:43385] regionserver.LeaseManager(133): Closed leases 2023-07-18 04:13:04,491 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35525,1689653423141] 2023-07-18 04:13:04,491 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 04:13:04,492 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35525,1689653423141; numProcessing=1 2023-07-18 04:13:04,491 INFO [RS:2;jenkins-hbase4:43385] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-18 04:13:04,492 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-18 04:13:04,493 INFO [RS:2;jenkins-hbase4:43385] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43385 2023-07-18 04:13:04,494 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 04:13:04,494 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:13:04,494 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42889,1689653423206 2023-07-18 04:13:04,495 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35525,1689653423141 already deleted, retry=false 2023-07-18 04:13:04,495 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35525,1689653423141 expired; onlineServers=2 2023-07-18 04:13:04,496 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:13:04,496 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43385,1689653423267 2023-07-18 04:13:04,496 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42889,1689653423206] 2023-07-18 04:13:04,496 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42889,1689653423206; numProcessing=2 2023-07-18 04:13:04,497 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42889,1689653423206 already deleted, retry=false 2023-07-18 04:13:04,497 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42889,1689653423206 expired; onlineServers=1 2023-07-18 04:13:04,497 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43385,1689653423267] 2023-07-18 04:13:04,497 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43385,1689653423267; numProcessing=3 2023-07-18 04:13:04,500 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43385,1689653423267 already deleted, retry=false 2023-07-18 04:13:04,500 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43385,1689653423267 expired; onlineServers=0 2023-07-18 04:13:04,500 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46231,1689653421609' ***** 2023-07-18 04:13:04,500 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-18 04:13:04,500 DEBUG [M:0;jenkins-hbase4:46231] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18461d71, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-18 04:13:04,500 INFO [M:0;jenkins-hbase4:46231] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46231,1689653421609 2023-07-18 04:13:04,500 INFO [M:0;jenkins-hbase4:46231] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46231,1689653421609; all regions closed. 2023-07-18 04:13:04,500 DEBUG [M:0;jenkins-hbase4:46231] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 04:13:04,500 DEBUG [M:0;jenkins-hbase4:46231] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-18 04:13:04,500 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-18 04:13:04,501 DEBUG [M:0;jenkins-hbase4:46231] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-18 04:13:04,501 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689653424976] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689653424976,5,FailOnTimeoutGroup] 2023-07-18 04:13:04,501 INFO [M:0;jenkins-hbase4:46231] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-18 04:13:04,501 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689653424990] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689653424990,5,FailOnTimeoutGroup] 2023-07-18 04:13:04,501 INFO [M:0;jenkins-hbase4:46231] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-18 04:13:04,501 INFO [M:0;jenkins-hbase4:46231] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-18 04:13:04,501 DEBUG [M:0;jenkins-hbase4:46231] master.HMaster(1512): Stopping service threads 2023-07-18 04:13:04,501 INFO [M:0;jenkins-hbase4:46231] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-18 04:13:04,501 ERROR [M:0;jenkins-hbase4:46231] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT 2023-07-18 04:13:04,502 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-18 04:13:04,502 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-18 04:13:04,502 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 04:13:04,503 INFO [M:0;jenkins-hbase4:46231] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-18 04:13:04,503 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-18 04:13:04,503 DEBUG [M:0;jenkins-hbase4:46231] zookeeper.ZKUtil(398): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-18 04:13:04,503 WARN [M:0;jenkins-hbase4:46231] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-18 04:13:04,503 INFO [M:0;jenkins-hbase4:46231] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-18 04:13:04,503 INFO [M:0;jenkins-hbase4:46231] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-18 04:13:04,504 DEBUG [M:0;jenkins-hbase4:46231] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-18 04:13:04,504 INFO [M:0;jenkins-hbase4:46231] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 04:13:04,504 DEBUG [M:0;jenkins-hbase4:46231] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 04:13:04,504 DEBUG [M:0;jenkins-hbase4:46231] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-18 04:13:04,504 DEBUG [M:0;jenkins-hbase4:46231] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 04:13:04,505 INFO [M:0;jenkins-hbase4:46231] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.86 KB heapSize=452.12 KB 2023-07-18 04:13:04,523 INFO [M:0;jenkins-hbase4:46231] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.86 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/81616450347041579af3692b49083a2e 2023-07-18 04:13:04,529 INFO [M:0;jenkins-hbase4:46231] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 81616450347041579af3692b49083a2e 2023-07-18 04:13:04,530 DEBUG [M:0;jenkins-hbase4:46231] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/81616450347041579af3692b49083a2e as hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/81616450347041579af3692b49083a2e 2023-07-18 04:13:04,535 INFO [M:0;jenkins-hbase4:46231] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 81616450347041579af3692b49083a2e 2023-07-18 04:13:04,535 INFO [M:0;jenkins-hbase4:46231] regionserver.HStore(1080): Added hdfs://localhost:43229/user/jenkins/test-data/0bb744c1-e175-4b67-c29b-1b09344a9af8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/81616450347041579af3692b49083a2e, entries=119, sequenceid=899, filesize=28.7 K 2023-07-18 04:13:04,536 INFO [M:0;jenkins-hbase4:46231] regionserver.HRegion(2948): Finished flush of dataSize ~375.86 KB/384876, heapSize ~452.10 KB/462952, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 31ms, sequenceid=899, compaction requested=false 2023-07-18 04:13:04,538 INFO [M:0;jenkins-hbase4:46231] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 04:13:04,538 DEBUG [M:0;jenkins-hbase4:46231] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-18 04:13:04,541 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-18 04:13:04,541 INFO [M:0;jenkins-hbase4:46231] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-18 04:13:04,543 INFO [M:0;jenkins-hbase4:46231] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46231 2023-07-18 04:13:04,547 DEBUG [M:0;jenkins-hbase4:46231] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,46231,1689653421609 already deleted, retry=false 2023-07-18 04:13:04,592 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 04:13:04,592 INFO [RS:0;jenkins-hbase4:35525] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,35525,1689653423141; zookeeper connection closed. 2023-07-18 04:13:04,593 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:35525-0x101769fa5910001, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 04:13:04,593 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@e852458] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@e852458 2023-07-18 04:13:04,693 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 04:13:04,693 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): master:46231-0x101769fa5910000, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 04:13:04,693 INFO [M:0;jenkins-hbase4:46231] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46231,1689653421609; zookeeper connection closed. 2023-07-18 04:13:04,793 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 04:13:04,793 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:43385-0x101769fa5910003, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 04:13:04,793 INFO [RS:2;jenkins-hbase4:43385] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43385,1689653423267; zookeeper connection closed. 2023-07-18 04:13:04,793 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6a3560b6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6a3560b6 2023-07-18 04:13:04,893 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 04:13:04,893 INFO [RS:1;jenkins-hbase4:42889] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42889,1689653423206; zookeeper connection closed. 2023-07-18 04:13:04,893 DEBUG [Listener at localhost/38339-EventThread] zookeeper.ZKWatcher(600): regionserver:42889-0x101769fa5910002, quorum=127.0.0.1:64260, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 04:13:04,893 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6b06cf21] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6b06cf21 2023-07-18 04:13:04,894 INFO [Listener at jenkins-hbase4.apache.org/40435] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-18 04:13:04,894 WARN [Listener at jenkins-hbase4.apache.org/40435] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-18 04:13:04,898 INFO [Listener at jenkins-hbase4.apache.org/40435] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-18 04:13:05,003 WARN [BP-2005763285-172.31.14.131-1689653417541 heartbeating to localhost/127.0.0.1:43229] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-18 04:13:05,003 WARN [BP-2005763285-172.31.14.131-1689653417541 heartbeating to localhost/127.0.0.1:43229] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2005763285-172.31.14.131-1689653417541 (Datanode Uuid df5eb385-908c-4373-a76a-1bd106aa162f) service to localhost/127.0.0.1:43229 2023-07-18 04:13:05,005 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/cluster_5a53e081-17bb-4aef-d48c-01add87bea50/dfs/data/data5/current/BP-2005763285-172.31.14.131-1689653417541] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 04:13:05,006 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/cluster_5a53e081-17bb-4aef-d48c-01add87bea50/dfs/data/data6/current/BP-2005763285-172.31.14.131-1689653417541] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 04:13:05,008 WARN [Listener at jenkins-hbase4.apache.org/40435] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-18 04:13:05,012 INFO [Listener at jenkins-hbase4.apache.org/40435] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-18 04:13:05,116 WARN [BP-2005763285-172.31.14.131-1689653417541 heartbeating to localhost/127.0.0.1:43229] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-18 04:13:05,116 WARN [BP-2005763285-172.31.14.131-1689653417541 heartbeating to localhost/127.0.0.1:43229] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2005763285-172.31.14.131-1689653417541 (Datanode Uuid 9baa9f1f-ac39-4f29-bf5a-4e60405968e1) service to localhost/127.0.0.1:43229 2023-07-18 04:13:05,117 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/cluster_5a53e081-17bb-4aef-d48c-01add87bea50/dfs/data/data3/current/BP-2005763285-172.31.14.131-1689653417541] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 04:13:05,117 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/cluster_5a53e081-17bb-4aef-d48c-01add87bea50/dfs/data/data4/current/BP-2005763285-172.31.14.131-1689653417541] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 04:13:05,118 WARN [Listener at jenkins-hbase4.apache.org/40435] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-18 04:13:05,123 INFO [Listener at jenkins-hbase4.apache.org/40435] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-18 04:13:05,226 WARN [BP-2005763285-172.31.14.131-1689653417541 heartbeating to localhost/127.0.0.1:43229] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-18 04:13:05,227 WARN [BP-2005763285-172.31.14.131-1689653417541 heartbeating to localhost/127.0.0.1:43229] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2005763285-172.31.14.131-1689653417541 (Datanode Uuid 9f179317-61d8-4a53-8bac-dcd0d5dd81c1) service to localhost/127.0.0.1:43229 2023-07-18 04:13:05,227 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/cluster_5a53e081-17bb-4aef-d48c-01add87bea50/dfs/data/data1/current/BP-2005763285-172.31.14.131-1689653417541] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 04:13:05,227 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10d69218-e914-bd63-8b29-fe0a26d674c6/cluster_5a53e081-17bb-4aef-d48c-01add87bea50/dfs/data/data2/current/BP-2005763285-172.31.14.131-1689653417541] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 04:13:05,251 INFO [Listener at jenkins-hbase4.apache.org/40435] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-18 04:13:05,377 INFO [Listener at jenkins-hbase4.apache.org/40435] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-18 04:13:05,480 INFO [Listener at jenkins-hbase4.apache.org/40435] hbase.HBaseTestingUtility(1293): Minicluster is down