2023-07-21 10:11:59,850 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-21 10:12:00,155 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f 2023-07-21 10:12:00,156 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-21 10:12:00,157 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-21 10:12:00,210 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-21 10:12:00,733 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-21 10:12:00,733 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/cluster_d3b934de-fe44-3c44-e8a2-d5b9df6d6477, deleteOnExit=true 2023-07-21 10:12:00,734 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-21 10:12:00,734 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/test.cache.data in system properties and HBase conf 2023-07-21 10:12:00,735 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/hadoop.tmp.dir in system properties and HBase conf 2023-07-21 10:12:00,737 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/hadoop.log.dir in system properties and HBase conf 2023-07-21 10:12:00,738 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-21 10:12:00,739 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-21 10:12:00,739 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-21 10:12:01,287 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-21 10:12:01,295 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-21 10:12:01,296 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-21 10:12:01,296 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-21 10:12:01,297 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-21 10:12:01,297 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-21 10:12:01,298 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-21 10:12:01,301 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-21 10:12:01,302 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-21 10:12:01,302 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-21 10:12:01,303 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/nfs.dump.dir in system properties and HBase conf 2023-07-21 10:12:01,303 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/java.io.tmpdir in system properties and HBase conf 2023-07-21 10:12:01,303 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-21 10:12:01,304 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-21 10:12:01,305 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-21 10:12:02,180 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-21 10:12:02,186 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-21 10:12:02,598 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-21 10:12:02,884 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-21 10:12:02,934 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 10:12:03,008 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 10:12:03,063 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/java.io.tmpdir/Jetty_localhost_localdomain_45523_hdfs____p5ler3/webapp 2023-07-21 10:12:03,248 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:45523 2023-07-21 10:12:03,266 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-21 10:12:03,270 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-21 10:12:04,210 WARN [Listener at localhost.localdomain/35937] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-21 10:12:04,441 WARN [Listener at localhost.localdomain/35937] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-21 10:12:04,490 WARN [Listener at localhost.localdomain/35937] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 10:12:04,500 INFO [Listener at localhost.localdomain/35937] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 10:12:04,512 INFO [Listener at localhost.localdomain/35937] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/java.io.tmpdir/Jetty_localhost_44627_datanode____78myn6/webapp 2023-07-21 10:12:04,649 INFO [Listener at localhost.localdomain/35937] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44627 2023-07-21 10:12:05,097 WARN [Listener at localhost.localdomain/43905] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-21 10:12:05,133 WARN [Listener at localhost.localdomain/43905] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-21 10:12:05,146 WARN [Listener at localhost.localdomain/43905] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 10:12:05,149 INFO [Listener at localhost.localdomain/43905] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 10:12:05,167 INFO [Listener at localhost.localdomain/43905] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/java.io.tmpdir/Jetty_localhost_38885_datanode____viozh3/webapp 2023-07-21 10:12:05,292 INFO [Listener at localhost.localdomain/43905] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38885 2023-07-21 10:12:05,320 WARN [Listener at localhost.localdomain/36039] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-21 10:12:05,426 WARN [Listener at localhost.localdomain/36039] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-21 10:12:05,433 WARN [Listener at localhost.localdomain/36039] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 10:12:05,435 INFO [Listener at localhost.localdomain/36039] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 10:12:05,482 INFO [Listener at localhost.localdomain/36039] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/java.io.tmpdir/Jetty_localhost_37873_datanode____.d03dux/webapp 2023-07-21 10:12:05,690 INFO [Listener at localhost.localdomain/36039] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37873 2023-07-21 10:12:05,775 WARN [Listener at localhost.localdomain/37301] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-21 10:12:06,028 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1c796c3056673fd1: Processing first storage report for DS-4471940f-3970-4fbb-bfb9-26cf19489ef4 from datanode 29a3d87a-148d-407a-b69f-25f49469c08e 2023-07-21 10:12:06,032 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1c796c3056673fd1: from storage DS-4471940f-3970-4fbb-bfb9-26cf19489ef4 node DatanodeRegistration(127.0.0.1:42105, datanodeUuid=29a3d87a-148d-407a-b69f-25f49469c08e, infoPort=35541, infoSecurePort=0, ipcPort=37301, storageInfo=lv=-57;cid=testClusterID;nsid=2134859145;c=1689934322290), blocks: 0, hasStaleStorage: true, processing time: 3 msecs, invalidatedBlocks: 0 2023-07-21 10:12:06,032 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x508c4fabb30a2182: Processing first storage report for DS-5ef8930f-2466-49fe-b324-d407c3d39573 from datanode afdacffc-3284-4be1-a4d9-6217036df168 2023-07-21 10:12:06,032 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x508c4fabb30a2182: from storage DS-5ef8930f-2466-49fe-b324-d407c3d39573 node DatanodeRegistration(127.0.0.1:37345, datanodeUuid=afdacffc-3284-4be1-a4d9-6217036df168, infoPort=40801, infoSecurePort=0, ipcPort=43905, storageInfo=lv=-57;cid=testClusterID;nsid=2134859145;c=1689934322290), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-21 10:12:06,032 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5cb9ea6353b2d630: Processing first storage report for DS-823d7d59-7517-4b99-8ca9-4d5c63a16b95 from datanode 9cce5eec-6129-46ed-a8cf-1f041d161f8b 2023-07-21 10:12:06,033 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5cb9ea6353b2d630: from storage DS-823d7d59-7517-4b99-8ca9-4d5c63a16b95 node DatanodeRegistration(127.0.0.1:35539, datanodeUuid=9cce5eec-6129-46ed-a8cf-1f041d161f8b, infoPort=40411, infoSecurePort=0, ipcPort=36039, storageInfo=lv=-57;cid=testClusterID;nsid=2134859145;c=1689934322290), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-21 10:12:06,033 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1c796c3056673fd1: Processing first storage report for DS-564cd223-e6cc-42ae-b80b-46e870d93750 from datanode 29a3d87a-148d-407a-b69f-25f49469c08e 2023-07-21 10:12:06,033 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1c796c3056673fd1: from storage DS-564cd223-e6cc-42ae-b80b-46e870d93750 node DatanodeRegistration(127.0.0.1:42105, datanodeUuid=29a3d87a-148d-407a-b69f-25f49469c08e, infoPort=35541, infoSecurePort=0, ipcPort=37301, storageInfo=lv=-57;cid=testClusterID;nsid=2134859145;c=1689934322290), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-21 10:12:06,033 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x508c4fabb30a2182: Processing first storage report for DS-3911ff32-6908-4c42-8bc3-1b1589442083 from datanode afdacffc-3284-4be1-a4d9-6217036df168 2023-07-21 10:12:06,034 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x508c4fabb30a2182: from storage DS-3911ff32-6908-4c42-8bc3-1b1589442083 node DatanodeRegistration(127.0.0.1:37345, datanodeUuid=afdacffc-3284-4be1-a4d9-6217036df168, infoPort=40801, infoSecurePort=0, ipcPort=43905, storageInfo=lv=-57;cid=testClusterID;nsid=2134859145;c=1689934322290), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-21 10:12:06,034 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5cb9ea6353b2d630: Processing first storage report for DS-6da607a2-4bbd-4c8c-a7b9-5ff8cac2e4ca from datanode 9cce5eec-6129-46ed-a8cf-1f041d161f8b 2023-07-21 10:12:06,034 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5cb9ea6353b2d630: from storage DS-6da607a2-4bbd-4c8c-a7b9-5ff8cac2e4ca node DatanodeRegistration(127.0.0.1:35539, datanodeUuid=9cce5eec-6129-46ed-a8cf-1f041d161f8b, infoPort=40411, infoSecurePort=0, ipcPort=36039, storageInfo=lv=-57;cid=testClusterID;nsid=2134859145;c=1689934322290), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-21 10:12:06,347 DEBUG [Listener at localhost.localdomain/37301] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f 2023-07-21 10:12:06,465 INFO [Listener at localhost.localdomain/37301] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/cluster_d3b934de-fe44-3c44-e8a2-d5b9df6d6477/zookeeper_0, clientPort=56971, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/cluster_d3b934de-fe44-3c44-e8a2-d5b9df6d6477/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/cluster_d3b934de-fe44-3c44-e8a2-d5b9df6d6477/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-21 10:12:06,490 INFO [Listener at localhost.localdomain/37301] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=56971 2023-07-21 10:12:06,501 INFO [Listener at localhost.localdomain/37301] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 10:12:06,504 INFO [Listener at localhost.localdomain/37301] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 10:12:07,002 INFO [Listener at localhost.localdomain/37301] util.FSUtils(471): Created version file at hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f with version=8 2023-07-21 10:12:07,003 INFO [Listener at localhost.localdomain/37301] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/hbase-staging 2023-07-21 10:12:07,477 INFO [Listener at localhost.localdomain/37301] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-21 10:12:08,253 INFO [Listener at localhost.localdomain/37301] client.ConnectionUtils(127): master/jenkins-hbase17:0 server-side Connection retries=45 2023-07-21 10:12:08,297 INFO [Listener at localhost.localdomain/37301] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 10:12:08,298 INFO [Listener at localhost.localdomain/37301] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-21 10:12:08,298 INFO [Listener at localhost.localdomain/37301] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-21 10:12:08,298 INFO [Listener at localhost.localdomain/37301] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 10:12:08,298 INFO [Listener at localhost.localdomain/37301] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-21 10:12:08,465 INFO [Listener at localhost.localdomain/37301] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-21 10:12:08,562 DEBUG [Listener at localhost.localdomain/37301] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-21 10:12:08,679 INFO [Listener at localhost.localdomain/37301] ipc.NettyRpcServer(120): Bind to /136.243.18.41:35385 2023-07-21 10:12:08,692 INFO [Listener at localhost.localdomain/37301] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 10:12:08,694 INFO [Listener at localhost.localdomain/37301] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 10:12:08,713 INFO [Listener at localhost.localdomain/37301] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35385 connecting to ZooKeeper ensemble=127.0.0.1:56971 2023-07-21 10:12:08,768 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:353850x0, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-21 10:12:08,771 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:35385-0x101875ce5c10000 connected 2023-07-21 10:12:08,826 DEBUG [Listener at localhost.localdomain/37301] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-21 10:12:08,827 DEBUG [Listener at localhost.localdomain/37301] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 10:12:08,841 DEBUG [Listener at localhost.localdomain/37301] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-21 10:12:08,848 DEBUG [Listener at localhost.localdomain/37301] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35385 2023-07-21 10:12:08,849 DEBUG [Listener at localhost.localdomain/37301] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35385 2023-07-21 10:12:08,849 DEBUG [Listener at localhost.localdomain/37301] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35385 2023-07-21 10:12:08,855 DEBUG [Listener at localhost.localdomain/37301] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35385 2023-07-21 10:12:08,856 DEBUG [Listener at localhost.localdomain/37301] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35385 2023-07-21 10:12:08,865 INFO [Listener at localhost.localdomain/37301] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f, hbase.cluster.distributed=false 2023-07-21 10:12:08,938 INFO [Listener at localhost.localdomain/37301] client.ConnectionUtils(127): regionserver/jenkins-hbase17:0 server-side Connection retries=45 2023-07-21 10:12:08,938 INFO [Listener at localhost.localdomain/37301] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 10:12:08,939 INFO [Listener at localhost.localdomain/37301] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-21 10:12:08,939 INFO [Listener at localhost.localdomain/37301] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-21 10:12:08,939 INFO [Listener at localhost.localdomain/37301] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 10:12:08,939 INFO [Listener at localhost.localdomain/37301] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-21 10:12:08,944 INFO [Listener at localhost.localdomain/37301] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-21 10:12:08,947 INFO [Listener at localhost.localdomain/37301] ipc.NettyRpcServer(120): Bind to /136.243.18.41:36809 2023-07-21 10:12:08,951 INFO [Listener at localhost.localdomain/37301] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-21 10:12:08,958 INFO [Listener at localhost.localdomain/37301] mob.MobFileCache(124): MobFileCache disabled 2023-07-21 10:12:08,959 INFO [Listener at localhost.localdomain/37301] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 10:12:08,960 INFO [Listener at localhost.localdomain/37301] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 10:12:08,963 INFO [Listener at localhost.localdomain/37301] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36809 connecting to ZooKeeper ensemble=127.0.0.1:56971 2023-07-21 10:12:08,968 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:368090x0, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-21 10:12:08,969 DEBUG [Listener at localhost.localdomain/37301] zookeeper.ZKUtil(164): regionserver:368090x0, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-21 10:12:08,970 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36809-0x101875ce5c10001 connected 2023-07-21 10:12:08,971 DEBUG [Listener at localhost.localdomain/37301] zookeeper.ZKUtil(164): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 10:12:08,971 DEBUG [Listener at localhost.localdomain/37301] zookeeper.ZKUtil(164): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-21 10:12:08,972 DEBUG [Listener at localhost.localdomain/37301] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36809 2023-07-21 10:12:08,976 DEBUG [Listener at localhost.localdomain/37301] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36809 2023-07-21 10:12:08,987 DEBUG [Listener at localhost.localdomain/37301] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36809 2023-07-21 10:12:08,996 DEBUG [Listener at localhost.localdomain/37301] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36809 2023-07-21 10:12:08,997 DEBUG [Listener at localhost.localdomain/37301] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36809 2023-07-21 10:12:09,015 INFO [Listener at localhost.localdomain/37301] client.ConnectionUtils(127): regionserver/jenkins-hbase17:0 server-side Connection retries=45 2023-07-21 10:12:09,016 INFO [Listener at localhost.localdomain/37301] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 10:12:09,016 INFO [Listener at localhost.localdomain/37301] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-21 10:12:09,017 INFO [Listener at localhost.localdomain/37301] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-21 10:12:09,017 INFO [Listener at localhost.localdomain/37301] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 10:12:09,017 INFO [Listener at localhost.localdomain/37301] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-21 10:12:09,018 INFO [Listener at localhost.localdomain/37301] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-21 10:12:09,021 INFO [Listener at localhost.localdomain/37301] ipc.NettyRpcServer(120): Bind to /136.243.18.41:37151 2023-07-21 10:12:09,022 INFO [Listener at localhost.localdomain/37301] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-21 10:12:09,024 INFO [Listener at localhost.localdomain/37301] mob.MobFileCache(124): MobFileCache disabled 2023-07-21 10:12:09,026 INFO [Listener at localhost.localdomain/37301] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 10:12:09,029 INFO [Listener at localhost.localdomain/37301] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 10:12:09,032 INFO [Listener at localhost.localdomain/37301] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37151 connecting to ZooKeeper ensemble=127.0.0.1:56971 2023-07-21 10:12:09,039 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:371510x0, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-21 10:12:09,043 DEBUG [Listener at localhost.localdomain/37301] zookeeper.ZKUtil(164): regionserver:371510x0, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-21 10:12:09,044 DEBUG [Listener at localhost.localdomain/37301] zookeeper.ZKUtil(164): regionserver:371510x0, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 10:12:09,045 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:37151-0x101875ce5c10002 connected 2023-07-21 10:12:09,045 DEBUG [Listener at localhost.localdomain/37301] zookeeper.ZKUtil(164): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-21 10:12:09,050 DEBUG [Listener at localhost.localdomain/37301] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37151 2023-07-21 10:12:09,051 DEBUG [Listener at localhost.localdomain/37301] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37151 2023-07-21 10:12:09,051 DEBUG [Listener at localhost.localdomain/37301] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37151 2023-07-21 10:12:09,051 DEBUG [Listener at localhost.localdomain/37301] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37151 2023-07-21 10:12:09,052 DEBUG [Listener at localhost.localdomain/37301] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37151 2023-07-21 10:12:09,070 INFO [Listener at localhost.localdomain/37301] client.ConnectionUtils(127): regionserver/jenkins-hbase17:0 server-side Connection retries=45 2023-07-21 10:12:09,070 INFO [Listener at localhost.localdomain/37301] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 10:12:09,071 INFO [Listener at localhost.localdomain/37301] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-21 10:12:09,071 INFO [Listener at localhost.localdomain/37301] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-21 10:12:09,071 INFO [Listener at localhost.localdomain/37301] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 10:12:09,071 INFO [Listener at localhost.localdomain/37301] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-21 10:12:09,072 INFO [Listener at localhost.localdomain/37301] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-21 10:12:09,075 INFO [Listener at localhost.localdomain/37301] ipc.NettyRpcServer(120): Bind to /136.243.18.41:38751 2023-07-21 10:12:09,076 INFO [Listener at localhost.localdomain/37301] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-21 10:12:09,077 INFO [Listener at localhost.localdomain/37301] mob.MobFileCache(124): MobFileCache disabled 2023-07-21 10:12:09,078 INFO [Listener at localhost.localdomain/37301] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 10:12:09,079 INFO [Listener at localhost.localdomain/37301] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 10:12:09,081 INFO [Listener at localhost.localdomain/37301] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38751 connecting to ZooKeeper ensemble=127.0.0.1:56971 2023-07-21 10:12:09,086 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:387510x0, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-21 10:12:09,088 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38751-0x101875ce5c10003 connected 2023-07-21 10:12:09,089 DEBUG [Listener at localhost.localdomain/37301] zookeeper.ZKUtil(164): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-21 10:12:09,090 DEBUG [Listener at localhost.localdomain/37301] zookeeper.ZKUtil(164): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 10:12:09,091 DEBUG [Listener at localhost.localdomain/37301] zookeeper.ZKUtil(164): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-21 10:12:09,099 DEBUG [Listener at localhost.localdomain/37301] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38751 2023-07-21 10:12:09,099 DEBUG [Listener at localhost.localdomain/37301] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38751 2023-07-21 10:12:09,100 DEBUG [Listener at localhost.localdomain/37301] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38751 2023-07-21 10:12:09,100 DEBUG [Listener at localhost.localdomain/37301] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38751 2023-07-21 10:12:09,104 DEBUG [Listener at localhost.localdomain/37301] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38751 2023-07-21 10:12:09,110 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase17.apache.org,35385,1689934327246 2023-07-21 10:12:09,121 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-21 10:12:09,122 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase17.apache.org,35385,1689934327246 2023-07-21 10:12:09,143 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-21 10:12:09,143 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-21 10:12:09,143 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-21 10:12:09,143 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-21 10:12:09,143 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 10:12:09,147 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-21 10:12:09,148 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-21 10:12:09,148 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase17.apache.org,35385,1689934327246 from backup master directory 2023-07-21 10:12:09,154 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase17.apache.org,35385,1689934327246 2023-07-21 10:12:09,154 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-21 10:12:09,155 WARN [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-21 10:12:09,156 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase17.apache.org,35385,1689934327246 2023-07-21 10:12:09,159 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-21 10:12:09,161 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-21 10:12:09,297 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/hbase.id with ID: f77e164e-4b3e-45f5-ab2b-db8c55ac55aa 2023-07-21 10:12:09,355 INFO [master/jenkins-hbase17:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 10:12:09,374 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 10:12:09,485 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x6f52a01b to 127.0.0.1:56971 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:12:09,544 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@227faad2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:12:09,580 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-21 10:12:09,582 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-21 10:12:09,612 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-21 10:12:09,613 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-21 10:12:09,617 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-21 10:12:09,623 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-21 10:12:09,625 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-21 10:12:09,702 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/MasterData/data/master/store-tmp 2023-07-21 10:12:09,864 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:12:09,864 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-21 10:12:09,864 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 10:12:09,864 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 10:12:09,865 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-21 10:12:09,865 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 10:12:09,865 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 10:12:09,865 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-21 10:12:09,867 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/MasterData/WALs/jenkins-hbase17.apache.org,35385,1689934327246 2023-07-21 10:12:09,903 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C35385%2C1689934327246, suffix=, logDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/MasterData/WALs/jenkins-hbase17.apache.org,35385,1689934327246, archiveDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/MasterData/oldWALs, maxLogs=10 2023-07-21 10:12:10,003 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37345,DS-5ef8930f-2466-49fe-b324-d407c3d39573,DISK] 2023-07-21 10:12:10,003 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42105,DS-4471940f-3970-4fbb-bfb9-26cf19489ef4,DISK] 2023-07-21 10:12:10,003 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35539,DS-823d7d59-7517-4b99-8ca9-4d5c63a16b95,DISK] 2023-07-21 10:12:10,015 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-21 10:12:10,095 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/MasterData/WALs/jenkins-hbase17.apache.org,35385,1689934327246/jenkins-hbase17.apache.org%2C35385%2C1689934327246.1689934329920 2023-07-21 10:12:10,096 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42105,DS-4471940f-3970-4fbb-bfb9-26cf19489ef4,DISK], DatanodeInfoWithStorage[127.0.0.1:37345,DS-5ef8930f-2466-49fe-b324-d407c3d39573,DISK], DatanodeInfoWithStorage[127.0.0.1:35539,DS-823d7d59-7517-4b99-8ca9-4d5c63a16b95,DISK]] 2023-07-21 10:12:10,097 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-21 10:12:10,097 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:12:10,100 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-21 10:12:10,101 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-21 10:12:10,184 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-21 10:12:10,200 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-21 10:12:10,242 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-21 10:12:10,265 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:12:10,274 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-21 10:12:10,276 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-21 10:12:10,293 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-21 10:12:10,299 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 10:12:10,305 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66243647, jitterRate=-0.012892737984657288}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 10:12:10,306 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-21 10:12:10,321 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-21 10:12:10,357 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-21 10:12:10,357 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-21 10:12:10,364 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-21 10:12:10,366 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-21 10:12:10,421 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 54 msec 2023-07-21 10:12:10,422 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-21 10:12:10,465 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-21 10:12:10,474 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-21 10:12:10,511 INFO [master/jenkins-hbase17:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-21 10:12:10,518 INFO [master/jenkins-hbase17:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-21 10:12:10,520 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-21 10:12:10,529 INFO [master/jenkins-hbase17:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-21 10:12:10,538 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-21 10:12:10,564 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 10:12:10,566 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-21 10:12:10,568 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-21 10:12:10,598 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-21 10:12:10,606 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-21 10:12:10,606 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-21 10:12:10,606 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 10:12:10,607 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase17.apache.org,35385,1689934327246, sessionid=0x101875ce5c10000, setting cluster-up flag (Was=false) 2023-07-21 10:12:10,609 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-21 10:12:10,609 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-21 10:12:10,635 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 10:12:10,641 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-21 10:12:10,642 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase17.apache.org,35385,1689934327246 2023-07-21 10:12:10,647 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 10:12:10,657 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-21 10:12:10,660 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase17.apache.org,35385,1689934327246 2023-07-21 10:12:10,669 WARN [master/jenkins-hbase17:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp 2023-07-21 10:12:10,747 INFO [RS:0;jenkins-hbase17:36809] regionserver.HRegionServer(951): ClusterId : f77e164e-4b3e-45f5-ab2b-db8c55ac55aa 2023-07-21 10:12:10,795 INFO [RS:2;jenkins-hbase17:38751] regionserver.HRegionServer(951): ClusterId : f77e164e-4b3e-45f5-ab2b-db8c55ac55aa 2023-07-21 10:12:10,798 INFO [RS:1;jenkins-hbase17:37151] regionserver.HRegionServer(951): ClusterId : f77e164e-4b3e-45f5-ab2b-db8c55ac55aa 2023-07-21 10:12:10,800 DEBUG [RS:1;jenkins-hbase17:37151] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-21 10:12:10,800 DEBUG [RS:0;jenkins-hbase17:36809] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-21 10:12:10,800 DEBUG [RS:2;jenkins-hbase17:38751] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-21 10:12:10,809 DEBUG [RS:1;jenkins-hbase17:37151] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-21 10:12:10,809 DEBUG [RS:0;jenkins-hbase17:36809] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-21 10:12:10,809 DEBUG [RS:1;jenkins-hbase17:37151] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-21 10:12:10,809 DEBUG [RS:0;jenkins-hbase17:36809] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-21 10:12:10,811 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-21 10:12:10,813 DEBUG [RS:0;jenkins-hbase17:36809] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-21 10:12:10,813 DEBUG [RS:1;jenkins-hbase17:37151] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-21 10:12:10,815 DEBUG [RS:2;jenkins-hbase17:38751] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-21 10:12:10,817 DEBUG [RS:2;jenkins-hbase17:38751] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-21 10:12:10,817 INFO [master/jenkins-hbase17:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:12:10,818 INFO [master/jenkins-hbase17:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-21 10:12:10,816 DEBUG [RS:0;jenkins-hbase17:36809] zookeeper.ReadOnlyZKClient(139): Connect 0x48baed7b to 127.0.0.1:56971 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:12:10,824 DEBUG [RS:2;jenkins-hbase17:38751] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-21 10:12:10,829 DEBUG [RS:1;jenkins-hbase17:37151] zookeeper.ReadOnlyZKClient(139): Connect 0x600ebf08 to 127.0.0.1:56971 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:12:10,865 DEBUG [RS:2;jenkins-hbase17:38751] zookeeper.ReadOnlyZKClient(139): Connect 0x08683d7e to 127.0.0.1:56971 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:12:10,888 DEBUG [RS:0;jenkins-hbase17:36809] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@386c7132, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:12:10,889 DEBUG [RS:0;jenkins-hbase17:36809] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@404e7f5b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-07-21 10:12:10,920 DEBUG [RS:1;jenkins-hbase17:37151] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@355ff1c6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:12:10,921 DEBUG [RS:1;jenkins-hbase17:37151] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74fb8923, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-07-21 10:12:10,953 DEBUG [RS:0;jenkins-hbase17:36809] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase17:36809 2023-07-21 10:12:10,956 DEBUG [RS:1;jenkins-hbase17:37151] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase17:37151 2023-07-21 10:12:10,970 INFO [RS:1;jenkins-hbase17:37151] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-21 10:12:10,970 INFO [RS:1;jenkins-hbase17:37151] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-21 10:12:10,970 DEBUG [RS:1;jenkins-hbase17:37151] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-21 10:12:10,973 DEBUG [RS:2;jenkins-hbase17:38751] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4dcabd92, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:12:10,973 DEBUG [RS:2;jenkins-hbase17:38751] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ced6acf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-07-21 10:12:10,971 INFO [RS:0;jenkins-hbase17:36809] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-21 10:12:10,975 INFO [RS:0;jenkins-hbase17:36809] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-21 10:12:10,975 DEBUG [RS:0;jenkins-hbase17:36809] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-21 10:12:10,975 INFO [RS:1;jenkins-hbase17:37151] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:12:10,975 INFO [RS:0;jenkins-hbase17:36809] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:12:10,976 DEBUG [RS:0;jenkins-hbase17:36809] regionserver.HRegionServer(1022): About to register with Master. 2023-07-21 10:12:10,976 DEBUG [RS:1;jenkins-hbase17:37151] regionserver.HRegionServer(1022): About to register with Master. 2023-07-21 10:12:10,986 DEBUG [RS:2;jenkins-hbase17:38751] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase17:38751 2023-07-21 10:12:10,987 INFO [RS:2;jenkins-hbase17:38751] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-21 10:12:10,987 INFO [RS:2;jenkins-hbase17:38751] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-21 10:12:10,989 DEBUG [RS:2;jenkins-hbase17:38751] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-21 10:12:10,989 INFO [RS:2;jenkins-hbase17:38751] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:12:10,990 DEBUG [RS:2;jenkins-hbase17:38751] regionserver.HRegionServer(1022): About to register with Master. 2023-07-21 10:12:10,990 INFO [RS:1;jenkins-hbase17:37151] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,35385,1689934327246 with isa=jenkins-hbase17.apache.org/136.243.18.41:37151, startcode=1689934329015 2023-07-21 10:12:10,993 INFO [RS:0;jenkins-hbase17:36809] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,35385,1689934327246 with isa=jenkins-hbase17.apache.org/136.243.18.41:36809, startcode=1689934328937 2023-07-21 10:12:11,003 INFO [RS:2;jenkins-hbase17:38751] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,35385,1689934327246 with isa=jenkins-hbase17.apache.org/136.243.18.41:38751, startcode=1689934329069 2023-07-21 10:12:11,013 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-21 10:12:11,041 DEBUG [RS:1;jenkins-hbase17:37151] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-21 10:12:11,041 DEBUG [RS:0;jenkins-hbase17:36809] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-21 10:12:11,041 DEBUG [RS:2;jenkins-hbase17:38751] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-21 10:12:11,066 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-21 10:12:11,066 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-21 10:12:11,066 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-21 10:12:11,066 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-21 10:12:11,066 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase17:0, corePoolSize=10, maxPoolSize=10 2023-07-21 10:12:11,066 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,067 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-07-21 10:12:11,067 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,148 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689934361095 2023-07-21 10:12:11,151 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-21 10:12:11,166 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-21 10:12:11,167 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-21 10:12:11,169 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-21 10:12:11,181 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-21 10:12:11,187 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-21 10:12:11,188 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-21 10:12:11,188 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-21 10:12:11,190 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-21 10:12:11,192 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:11,210 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:56315, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-21 10:12:11,210 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:49495, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-21 10:12:11,212 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-21 10:12:11,210 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:45975, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-21 10:12:11,215 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-21 10:12:11,216 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-21 10:12:11,223 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-21 10:12:11,223 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35385] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-21 10:12:11,224 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-21 10:12:11,235 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35385] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-21 10:12:11,237 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1689934331226,5,FailOnTimeoutGroup] 2023-07-21 10:12:11,241 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1689934331238,5,FailOnTimeoutGroup] 2023-07-21 10:12:11,241 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:11,241 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35385] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-21 10:12:11,241 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-21 10:12:11,243 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:11,244 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:11,290 DEBUG [RS:0;jenkins-hbase17:36809] regionserver.HRegionServer(2830): Master is not running yet 2023-07-21 10:12:11,291 WARN [RS:0;jenkins-hbase17:36809] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-21 10:12:11,299 DEBUG [RS:1;jenkins-hbase17:37151] regionserver.HRegionServer(2830): Master is not running yet 2023-07-21 10:12:11,299 WARN [RS:1;jenkins-hbase17:37151] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-21 10:12:11,300 DEBUG [RS:2;jenkins-hbase17:38751] regionserver.HRegionServer(2830): Master is not running yet 2023-07-21 10:12:11,300 WARN [RS:2;jenkins-hbase17:38751] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-21 10:12:11,353 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-21 10:12:11,355 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-21 10:12:11,355 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f 2023-07-21 10:12:11,392 INFO [RS:0;jenkins-hbase17:36809] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,35385,1689934327246 with isa=jenkins-hbase17.apache.org/136.243.18.41:36809, startcode=1689934328937 2023-07-21 10:12:11,408 INFO [RS:1;jenkins-hbase17:37151] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,35385,1689934327246 with isa=jenkins-hbase17.apache.org/136.243.18.41:37151, startcode=1689934329015 2023-07-21 10:12:11,433 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35385] master.ServerManager(394): Registering regionserver=jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:11,434 INFO [RS:2;jenkins-hbase17:38751] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,35385,1689934327246 with isa=jenkins-hbase17.apache.org/136.243.18.41:38751, startcode=1689934329069 2023-07-21 10:12:11,439 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35385] master.ServerManager(394): Registering regionserver=jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:11,442 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35385] master.ServerManager(394): Registering regionserver=jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:11,443 DEBUG [RS:0;jenkins-hbase17:36809] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f 2023-07-21 10:12:11,443 DEBUG [RS:2;jenkins-hbase17:38751] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f 2023-07-21 10:12:11,444 DEBUG [RS:2;jenkins-hbase17:38751] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:35937 2023-07-21 10:12:11,445 DEBUG [RS:2;jenkins-hbase17:38751] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-21 10:12:11,443 DEBUG [RS:0;jenkins-hbase17:36809] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:35937 2023-07-21 10:12:11,452 DEBUG [RS:0;jenkins-hbase17:36809] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-21 10:12:11,476 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-21 10:12:11,485 DEBUG [RS:2;jenkins-hbase17:38751] zookeeper.ZKUtil(162): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:11,485 WARN [RS:2;jenkins-hbase17:38751] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-21 10:12:11,497 INFO [RS:2;jenkins-hbase17:38751] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-21 10:12:11,498 DEBUG [RS:2;jenkins-hbase17:38751] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/WALs/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:11,499 DEBUG [RS:0;jenkins-hbase17:36809] zookeeper.ZKUtil(162): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:11,499 DEBUG [RS:1;jenkins-hbase17:37151] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f 2023-07-21 10:12:11,499 DEBUG [RS:1;jenkins-hbase17:37151] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:35937 2023-07-21 10:12:11,499 DEBUG [RS:1;jenkins-hbase17:37151] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-21 10:12:11,503 DEBUG [RS:1;jenkins-hbase17:37151] zookeeper.ZKUtil(162): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:11,505 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase17.apache.org,37151,1689934329015] 2023-07-21 10:12:11,505 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase17.apache.org,36809,1689934328937] 2023-07-21 10:12:11,505 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase17.apache.org,38751,1689934329069] 2023-07-21 10:12:11,499 WARN [RS:0;jenkins-hbase17:36809] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-21 10:12:11,503 WARN [RS:1;jenkins-hbase17:37151] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-21 10:12:11,525 INFO [RS:1;jenkins-hbase17:37151] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-21 10:12:11,525 DEBUG [RS:1;jenkins-hbase17:37151] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/WALs/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:11,516 INFO [RS:0;jenkins-hbase17:36809] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-21 10:12:11,527 DEBUG [RS:0;jenkins-hbase17:36809] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/WALs/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:11,563 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:12:11,569 DEBUG [RS:0;jenkins-hbase17:36809] zookeeper.ZKUtil(162): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:11,570 DEBUG [RS:0;jenkins-hbase17:36809] zookeeper.ZKUtil(162): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:11,570 DEBUG [RS:2;jenkins-hbase17:38751] zookeeper.ZKUtil(162): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:11,573 DEBUG [RS:0;jenkins-hbase17:36809] zookeeper.ZKUtil(162): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:11,573 DEBUG [RS:2;jenkins-hbase17:38751] zookeeper.ZKUtil(162): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:11,573 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-21 10:12:11,575 DEBUG [RS:2;jenkins-hbase17:38751] zookeeper.ZKUtil(162): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:11,581 DEBUG [RS:1;jenkins-hbase17:37151] zookeeper.ZKUtil(162): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:11,582 DEBUG [RS:1;jenkins-hbase17:37151] zookeeper.ZKUtil(162): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:11,582 DEBUG [RS:1;jenkins-hbase17:37151] zookeeper.ZKUtil(162): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:11,587 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/meta/1588230740/info 2023-07-21 10:12:11,589 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-21 10:12:11,605 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:12:11,605 DEBUG [RS:1;jenkins-hbase17:37151] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-21 10:12:11,606 DEBUG [RS:2;jenkins-hbase17:38751] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-21 10:12:11,606 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-21 10:12:11,609 DEBUG [RS:0;jenkins-hbase17:36809] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-21 10:12:11,614 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/meta/1588230740/rep_barrier 2023-07-21 10:12:11,614 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-21 10:12:11,617 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:12:11,617 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-21 10:12:11,625 INFO [RS:2;jenkins-hbase17:38751] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-21 10:12:11,628 INFO [RS:0;jenkins-hbase17:36809] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-21 10:12:11,635 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/meta/1588230740/table 2023-07-21 10:12:11,637 INFO [RS:1;jenkins-hbase17:37151] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-21 10:12:11,665 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-21 10:12:11,666 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:12:11,669 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/meta/1588230740 2023-07-21 10:12:11,724 INFO [RS:2;jenkins-hbase17:38751] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-21 10:12:11,726 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/meta/1588230740 2023-07-21 10:12:11,742 INFO [RS:2;jenkins-hbase17:38751] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-21 10:12:11,756 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-21 10:12:11,743 INFO [RS:0;jenkins-hbase17:36809] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-21 10:12:11,742 INFO [RS:2;jenkins-hbase17:38751] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:11,752 INFO [RS:1;jenkins-hbase17:37151] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-21 10:12:11,761 INFO [RS:2;jenkins-hbase17:38751] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-21 10:12:11,760 INFO [RS:0;jenkins-hbase17:36809] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-21 10:12:11,765 INFO [RS:0;jenkins-hbase17:36809] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:11,766 INFO [RS:1;jenkins-hbase17:37151] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-21 10:12:11,766 INFO [RS:1;jenkins-hbase17:37151] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:11,773 INFO [RS:1;jenkins-hbase17:37151] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-21 10:12:11,775 INFO [RS:0;jenkins-hbase17:36809] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-21 10:12:11,776 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-21 10:12:11,786 INFO [RS:2;jenkins-hbase17:38751] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:11,786 INFO [RS:1;jenkins-hbase17:37151] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:11,786 DEBUG [RS:2;jenkins-hbase17:38751] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,786 INFO [RS:0;jenkins-hbase17:36809] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:11,786 DEBUG [RS:2;jenkins-hbase17:38751] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,786 DEBUG [RS:1;jenkins-hbase17:37151] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,802 DEBUG [RS:2;jenkins-hbase17:38751] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,802 DEBUG [RS:1;jenkins-hbase17:37151] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,803 DEBUG [RS:2;jenkins-hbase17:38751] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,803 DEBUG [RS:1;jenkins-hbase17:37151] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,803 DEBUG [RS:2;jenkins-hbase17:38751] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,803 DEBUG [RS:1;jenkins-hbase17:37151] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,803 DEBUG [RS:2;jenkins-hbase17:38751] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-07-21 10:12:11,803 DEBUG [RS:1;jenkins-hbase17:37151] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,803 DEBUG [RS:2;jenkins-hbase17:38751] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,803 DEBUG [RS:1;jenkins-hbase17:37151] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-07-21 10:12:11,803 DEBUG [RS:2;jenkins-hbase17:38751] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,803 DEBUG [RS:2;jenkins-hbase17:38751] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,786 DEBUG [RS:0;jenkins-hbase17:36809] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,803 DEBUG [RS:1;jenkins-hbase17:37151] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,804 DEBUG [RS:0;jenkins-hbase17:36809] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,804 DEBUG [RS:1;jenkins-hbase17:37151] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,804 DEBUG [RS:0;jenkins-hbase17:36809] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,804 DEBUG [RS:1;jenkins-hbase17:37151] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,804 DEBUG [RS:0;jenkins-hbase17:36809] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,804 DEBUG [RS:1;jenkins-hbase17:37151] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,804 DEBUG [RS:0;jenkins-hbase17:36809] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,803 DEBUG [RS:2;jenkins-hbase17:38751] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,804 DEBUG [RS:0;jenkins-hbase17:36809] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-07-21 10:12:11,804 DEBUG [RS:0;jenkins-hbase17:36809] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,805 DEBUG [RS:0;jenkins-hbase17:36809] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,805 DEBUG [RS:0;jenkins-hbase17:36809] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,805 DEBUG [RS:0;jenkins-hbase17:36809] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,806 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 10:12:11,807 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74248942, jitterRate=0.10639545321464539}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-21 10:12:11,807 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-21 10:12:11,808 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-21 10:12:11,808 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-21 10:12:11,808 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-21 10:12:11,808 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-21 10:12:11,808 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-21 10:12:11,813 INFO [RS:1;jenkins-hbase17:37151] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:11,813 INFO [RS:1;jenkins-hbase17:37151] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:11,813 INFO [RS:1;jenkins-hbase17:37151] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:11,846 INFO [RS:0;jenkins-hbase17:36809] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:11,846 INFO [RS:0;jenkins-hbase17:36809] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:11,847 INFO [RS:0;jenkins-hbase17:36809] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:11,849 INFO [RS:1;jenkins-hbase17:37151] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-21 10:12:11,852 INFO [RS:1;jenkins-hbase17:37151] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,37151,1689934329015-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:11,858 INFO [RS:2;jenkins-hbase17:38751] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:11,858 INFO [RS:2;jenkins-hbase17:38751] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:11,858 INFO [RS:2;jenkins-hbase17:38751] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:11,861 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-21 10:12:11,869 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-21 10:12:11,881 INFO [RS:0;jenkins-hbase17:36809] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-21 10:12:11,888 INFO [RS:0;jenkins-hbase17:36809] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,36809,1689934328937-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:11,900 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-21 10:12:11,900 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-21 10:12:11,910 INFO [RS:2;jenkins-hbase17:38751] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-21 10:12:11,913 INFO [RS:2;jenkins-hbase17:38751] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,38751,1689934329069-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:11,948 INFO [RS:0;jenkins-hbase17:36809] regionserver.Replication(203): jenkins-hbase17.apache.org,36809,1689934328937 started 2023-07-21 10:12:11,948 INFO [RS:0;jenkins-hbase17:36809] regionserver.HRegionServer(1637): Serving as jenkins-hbase17.apache.org,36809,1689934328937, RpcServer on jenkins-hbase17.apache.org/136.243.18.41:36809, sessionid=0x101875ce5c10001 2023-07-21 10:12:11,949 DEBUG [RS:0;jenkins-hbase17:36809] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-21 10:12:11,949 DEBUG [RS:0;jenkins-hbase17:36809] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:11,949 DEBUG [RS:0;jenkins-hbase17:36809] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,36809,1689934328937' 2023-07-21 10:12:11,949 DEBUG [RS:0;jenkins-hbase17:36809] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-21 10:12:11,950 DEBUG [RS:0;jenkins-hbase17:36809] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-21 10:12:11,950 DEBUG [RS:0;jenkins-hbase17:36809] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-21 10:12:11,951 DEBUG [RS:0;jenkins-hbase17:36809] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-21 10:12:11,951 DEBUG [RS:0;jenkins-hbase17:36809] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:11,951 DEBUG [RS:0;jenkins-hbase17:36809] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,36809,1689934328937' 2023-07-21 10:12:11,951 DEBUG [RS:0;jenkins-hbase17:36809] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:11,951 DEBUG [RS:0;jenkins-hbase17:36809] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:11,952 DEBUG [RS:0;jenkins-hbase17:36809] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-21 10:12:11,952 INFO [RS:0;jenkins-hbase17:36809] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-21 10:12:11,952 INFO [RS:0;jenkins-hbase17:36809] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-21 10:12:11,960 INFO [RS:2;jenkins-hbase17:38751] regionserver.Replication(203): jenkins-hbase17.apache.org,38751,1689934329069 started 2023-07-21 10:12:11,960 INFO [RS:2;jenkins-hbase17:38751] regionserver.HRegionServer(1637): Serving as jenkins-hbase17.apache.org,38751,1689934329069, RpcServer on jenkins-hbase17.apache.org/136.243.18.41:38751, sessionid=0x101875ce5c10003 2023-07-21 10:12:11,961 DEBUG [RS:2;jenkins-hbase17:38751] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-21 10:12:11,961 DEBUG [RS:2;jenkins-hbase17:38751] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:11,980 INFO [RS:1;jenkins-hbase17:37151] regionserver.Replication(203): jenkins-hbase17.apache.org,37151,1689934329015 started 2023-07-21 10:12:11,980 INFO [RS:1;jenkins-hbase17:37151] regionserver.HRegionServer(1637): Serving as jenkins-hbase17.apache.org,37151,1689934329015, RpcServer on jenkins-hbase17.apache.org/136.243.18.41:37151, sessionid=0x101875ce5c10002 2023-07-21 10:12:11,980 DEBUG [RS:1;jenkins-hbase17:37151] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-21 10:12:11,980 DEBUG [RS:1;jenkins-hbase17:37151] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:11,984 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-21 10:12:11,977 DEBUG [RS:2;jenkins-hbase17:38751] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,38751,1689934329069' 2023-07-21 10:12:11,989 DEBUG [RS:2;jenkins-hbase17:38751] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-21 10:12:11,990 DEBUG [RS:2;jenkins-hbase17:38751] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-21 10:12:11,981 DEBUG [RS:1;jenkins-hbase17:37151] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,37151,1689934329015' 2023-07-21 10:12:11,995 DEBUG [RS:2;jenkins-hbase17:38751] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-21 10:12:11,998 DEBUG [RS:2;jenkins-hbase17:38751] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-21 10:12:11,998 DEBUG [RS:1;jenkins-hbase17:37151] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-21 10:12:11,998 DEBUG [RS:2;jenkins-hbase17:38751] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:12,000 DEBUG [RS:2;jenkins-hbase17:38751] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,38751,1689934329069' 2023-07-21 10:12:12,000 DEBUG [RS:2;jenkins-hbase17:38751] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:12,001 DEBUG [RS:2;jenkins-hbase17:38751] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:12,001 DEBUG [RS:1;jenkins-hbase17:37151] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-21 10:12:12,002 DEBUG [RS:1;jenkins-hbase17:37151] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-21 10:12:12,002 DEBUG [RS:2;jenkins-hbase17:38751] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-21 10:12:12,002 DEBUG [RS:1;jenkins-hbase17:37151] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-21 10:12:12,002 INFO [RS:2;jenkins-hbase17:38751] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-21 10:12:12,003 DEBUG [RS:1;jenkins-hbase17:37151] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:12,004 INFO [RS:2;jenkins-hbase17:38751] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-21 10:12:12,004 DEBUG [RS:1;jenkins-hbase17:37151] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,37151,1689934329015' 2023-07-21 10:12:12,004 DEBUG [RS:1;jenkins-hbase17:37151] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:12,007 DEBUG [RS:1;jenkins-hbase17:37151] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:12,007 DEBUG [RS:1;jenkins-hbase17:37151] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-21 10:12:12,008 INFO [RS:1;jenkins-hbase17:37151] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-21 10:12:12,008 INFO [RS:1;jenkins-hbase17:37151] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-21 10:12:12,018 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-21 10:12:12,022 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-21 10:12:12,070 INFO [RS:0;jenkins-hbase17:36809] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C36809%2C1689934328937, suffix=, logDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/WALs/jenkins-hbase17.apache.org,36809,1689934328937, archiveDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/oldWALs, maxLogs=32 2023-07-21 10:12:12,128 INFO [RS:2;jenkins-hbase17:38751] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C38751%2C1689934329069, suffix=, logDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/WALs/jenkins-hbase17.apache.org,38751,1689934329069, archiveDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/oldWALs, maxLogs=32 2023-07-21 10:12:12,135 INFO [RS:1;jenkins-hbase17:37151] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C37151%2C1689934329015, suffix=, logDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/WALs/jenkins-hbase17.apache.org,37151,1689934329015, archiveDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/oldWALs, maxLogs=32 2023-07-21 10:12:12,137 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42105,DS-4471940f-3970-4fbb-bfb9-26cf19489ef4,DISK] 2023-07-21 10:12:12,138 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37345,DS-5ef8930f-2466-49fe-b324-d407c3d39573,DISK] 2023-07-21 10:12:12,141 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35539,DS-823d7d59-7517-4b99-8ca9-4d5c63a16b95,DISK] 2023-07-21 10:12:12,176 DEBUG [jenkins-hbase17:35385] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-21 10:12:12,226 DEBUG [jenkins-hbase17:35385] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-21 10:12:12,243 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35539,DS-823d7d59-7517-4b99-8ca9-4d5c63a16b95,DISK] 2023-07-21 10:12:12,249 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42105,DS-4471940f-3970-4fbb-bfb9-26cf19489ef4,DISK] 2023-07-21 10:12:12,251 INFO [RS:0;jenkins-hbase17:36809] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/WALs/jenkins-hbase17.apache.org,36809,1689934328937/jenkins-hbase17.apache.org%2C36809%2C1689934328937.1689934332076 2023-07-21 10:12:12,309 DEBUG [RS:0;jenkins-hbase17:36809] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37345,DS-5ef8930f-2466-49fe-b324-d407c3d39573,DISK], DatanodeInfoWithStorage[127.0.0.1:35539,DS-823d7d59-7517-4b99-8ca9-4d5c63a16b95,DISK], DatanodeInfoWithStorage[127.0.0.1:42105,DS-4471940f-3970-4fbb-bfb9-26cf19489ef4,DISK]] 2023-07-21 10:12:12,330 DEBUG [jenkins-hbase17:35385] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 10:12:12,350 DEBUG [jenkins-hbase17:35385] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 10:12:12,350 DEBUG [jenkins-hbase17:35385] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 10:12:12,351 DEBUG [jenkins-hbase17:35385] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 10:12:12,321 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37345,DS-5ef8930f-2466-49fe-b324-d407c3d39573,DISK] 2023-07-21 10:12:12,319 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42105,DS-4471940f-3970-4fbb-bfb9-26cf19489ef4,DISK] 2023-07-21 10:12:12,367 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,38751,1689934329069, state=OPENING 2023-07-21 10:12:12,380 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35539,DS-823d7d59-7517-4b99-8ca9-4d5c63a16b95,DISK] 2023-07-21 10:12:12,381 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37345,DS-5ef8930f-2466-49fe-b324-d407c3d39573,DISK] 2023-07-21 10:12:12,384 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-21 10:12:12,390 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 10:12:12,391 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-21 10:12:12,402 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,38751,1689934329069}] 2023-07-21 10:12:12,453 INFO [RS:2;jenkins-hbase17:38751] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/WALs/jenkins-hbase17.apache.org,38751,1689934329069/jenkins-hbase17.apache.org%2C38751%2C1689934329069.1689934332133 2023-07-21 10:12:12,454 DEBUG [RS:2;jenkins-hbase17:38751] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37345,DS-5ef8930f-2466-49fe-b324-d407c3d39573,DISK], DatanodeInfoWithStorage[127.0.0.1:35539,DS-823d7d59-7517-4b99-8ca9-4d5c63a16b95,DISK], DatanodeInfoWithStorage[127.0.0.1:42105,DS-4471940f-3970-4fbb-bfb9-26cf19489ef4,DISK]] 2023-07-21 10:12:12,474 INFO [RS:1;jenkins-hbase17:37151] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/WALs/jenkins-hbase17.apache.org,37151,1689934329015/jenkins-hbase17.apache.org%2C37151%2C1689934329015.1689934332137 2023-07-21 10:12:12,476 DEBUG [RS:1;jenkins-hbase17:37151] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35539,DS-823d7d59-7517-4b99-8ca9-4d5c63a16b95,DISK], DatanodeInfoWithStorage[127.0.0.1:42105,DS-4471940f-3970-4fbb-bfb9-26cf19489ef4,DISK], DatanodeInfoWithStorage[127.0.0.1:37345,DS-5ef8930f-2466-49fe-b324-d407c3d39573,DISK]] 2023-07-21 10:12:12,683 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:12,686 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-21 10:12:12,692 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:48200, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-21 10:12:12,750 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-21 10:12:12,750 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-21 10:12:12,755 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C38751%2C1689934329069.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/WALs/jenkins-hbase17.apache.org,38751,1689934329069, archiveDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/oldWALs, maxLogs=32 2023-07-21 10:12:12,827 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37345,DS-5ef8930f-2466-49fe-b324-d407c3d39573,DISK] 2023-07-21 10:12:12,827 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42105,DS-4471940f-3970-4fbb-bfb9-26cf19489ef4,DISK] 2023-07-21 10:12:12,828 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35539,DS-823d7d59-7517-4b99-8ca9-4d5c63a16b95,DISK] 2023-07-21 10:12:12,865 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/WALs/jenkins-hbase17.apache.org,38751,1689934329069/jenkins-hbase17.apache.org%2C38751%2C1689934329069.meta.1689934332757.meta 2023-07-21 10:12:12,867 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35539,DS-823d7d59-7517-4b99-8ca9-4d5c63a16b95,DISK], DatanodeInfoWithStorage[127.0.0.1:42105,DS-4471940f-3970-4fbb-bfb9-26cf19489ef4,DISK], DatanodeInfoWithStorage[127.0.0.1:37345,DS-5ef8930f-2466-49fe-b324-d407c3d39573,DISK]] 2023-07-21 10:12:12,868 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-21 10:12:12,869 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-21 10:12:12,870 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:12:12,871 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-21 10:12:12,873 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-21 10:12:12,875 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-21 10:12:12,894 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-21 10:12:12,894 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:12:12,894 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-21 10:12:12,894 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-21 10:12:12,902 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-21 10:12:12,904 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/meta/1588230740/info 2023-07-21 10:12:12,904 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/meta/1588230740/info 2023-07-21 10:12:12,905 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-21 10:12:12,909 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:12:12,909 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-21 10:12:12,911 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/meta/1588230740/rep_barrier 2023-07-21 10:12:12,911 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/meta/1588230740/rep_barrier 2023-07-21 10:12:12,912 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-21 10:12:12,914 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:12:12,914 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-21 10:12:12,917 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/meta/1588230740/table 2023-07-21 10:12:12,918 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/meta/1588230740/table 2023-07-21 10:12:12,918 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-21 10:12:12,922 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:12:12,926 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/meta/1588230740 2023-07-21 10:12:12,933 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/meta/1588230740 2023-07-21 10:12:12,938 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-21 10:12:12,941 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-21 10:12:12,958 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61128067, jitterRate=-0.08912082016468048}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-21 10:12:12,961 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-21 10:12:12,980 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689934332657 2023-07-21 10:12:13,009 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-21 10:12:13,013 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,38751,1689934329069, state=OPEN 2023-07-21 10:12:13,015 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-21 10:12:13,017 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-21 10:12:13,017 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-21 10:12:13,032 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-21 10:12:13,032 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,38751,1689934329069 in 614 msec 2023-07-21 10:12:13,044 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-21 10:12:13,044 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 1.0870 sec 2023-07-21 10:12:13,057 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 2.2190 sec 2023-07-21 10:12:13,058 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689934333057, completionTime=-1 2023-07-21 10:12:13,058 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-21 10:12:13,058 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-21 10:12:13,172 DEBUG [hconnection-0x1bf23fcf-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:12:13,191 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:48204, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:12:13,231 INFO [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-21 10:12:13,231 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689934393231 2023-07-21 10:12:13,231 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689934453231 2023-07-21 10:12:13,231 INFO [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 173 msec 2023-07-21 10:12:13,290 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,35385,1689934327246-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:13,290 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,35385,1689934327246-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:13,291 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,35385,1689934327246-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:13,294 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase17:35385, period=300000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:13,308 DEBUG [master/jenkins-hbase17:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-21 10:12:13,310 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:13,341 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-21 10:12:13,343 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-21 10:12:13,358 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-21 10:12:13,363 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 10:12:13,368 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 10:12:13,397 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/hbase/namespace/646c4734d454181f95516b751d1a6763 2023-07-21 10:12:13,400 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/hbase/namespace/646c4734d454181f95516b751d1a6763 empty. 2023-07-21 10:12:13,402 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/hbase/namespace/646c4734d454181f95516b751d1a6763 2023-07-21 10:12:13,402 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-21 10:12:13,510 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-21 10:12:13,529 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 646c4734d454181f95516b751d1a6763, NAME => 'hbase:namespace,,1689934333342.646c4734d454181f95516b751d1a6763.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp 2023-07-21 10:12:13,657 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689934333342.646c4734d454181f95516b751d1a6763.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:12:13,657 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 646c4734d454181f95516b751d1a6763, disabling compactions & flushes 2023-07-21 10:12:13,657 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689934333342.646c4734d454181f95516b751d1a6763. 2023-07-21 10:12:13,657 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689934333342.646c4734d454181f95516b751d1a6763. 2023-07-21 10:12:13,657 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689934333342.646c4734d454181f95516b751d1a6763. after waiting 0 ms 2023-07-21 10:12:13,657 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689934333342.646c4734d454181f95516b751d1a6763. 2023-07-21 10:12:13,657 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689934333342.646c4734d454181f95516b751d1a6763. 2023-07-21 10:12:13,657 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 646c4734d454181f95516b751d1a6763: 2023-07-21 10:12:13,679 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 10:12:13,700 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689934333342.646c4734d454181f95516b751d1a6763.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689934333685"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934333685"}]},"ts":"1689934333685"} 2023-07-21 10:12:13,755 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-21 10:12:13,759 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 10:12:13,765 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934333760"}]},"ts":"1689934333760"} 2023-07-21 10:12:13,770 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-21 10:12:13,774 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-21 10:12:13,776 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 10:12:13,776 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 10:12:13,776 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 10:12:13,776 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 10:12:13,779 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=646c4734d454181f95516b751d1a6763, ASSIGN}] 2023-07-21 10:12:13,789 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=646c4734d454181f95516b751d1a6763, ASSIGN 2023-07-21 10:12:13,794 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=646c4734d454181f95516b751d1a6763, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,36809,1689934328937; forceNewPlan=false, retain=false 2023-07-21 10:12:13,947 INFO [jenkins-hbase17:35385] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-21 10:12:13,949 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=646c4734d454181f95516b751d1a6763, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:13,949 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689934333342.646c4734d454181f95516b751d1a6763.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689934333948"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934333948"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934333948"}]},"ts":"1689934333948"} 2023-07-21 10:12:13,954 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 646c4734d454181f95516b751d1a6763, server=jenkins-hbase17.apache.org,36809,1689934328937}] 2023-07-21 10:12:14,116 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:14,117 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-21 10:12:14,123 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:38808, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-21 10:12:14,132 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689934333342.646c4734d454181f95516b751d1a6763. 2023-07-21 10:12:14,132 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 646c4734d454181f95516b751d1a6763, NAME => 'hbase:namespace,,1689934333342.646c4734d454181f95516b751d1a6763.', STARTKEY => '', ENDKEY => ''} 2023-07-21 10:12:14,133 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689934333342.646c4734d454181f95516b751d1a6763. service=AccessControlService 2023-07-21 10:12:14,133 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:12:14,134 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 646c4734d454181f95516b751d1a6763 2023-07-21 10:12:14,134 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689934333342.646c4734d454181f95516b751d1a6763.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:12:14,134 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 646c4734d454181f95516b751d1a6763 2023-07-21 10:12:14,134 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 646c4734d454181f95516b751d1a6763 2023-07-21 10:12:14,144 INFO [StoreOpener-646c4734d454181f95516b751d1a6763-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 646c4734d454181f95516b751d1a6763 2023-07-21 10:12:14,148 DEBUG [StoreOpener-646c4734d454181f95516b751d1a6763-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/namespace/646c4734d454181f95516b751d1a6763/info 2023-07-21 10:12:14,148 DEBUG [StoreOpener-646c4734d454181f95516b751d1a6763-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/namespace/646c4734d454181f95516b751d1a6763/info 2023-07-21 10:12:14,149 INFO [StoreOpener-646c4734d454181f95516b751d1a6763-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 646c4734d454181f95516b751d1a6763 columnFamilyName info 2023-07-21 10:12:14,152 INFO [StoreOpener-646c4734d454181f95516b751d1a6763-1] regionserver.HStore(310): Store=646c4734d454181f95516b751d1a6763/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:12:14,155 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/namespace/646c4734d454181f95516b751d1a6763 2023-07-21 10:12:14,158 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/namespace/646c4734d454181f95516b751d1a6763 2023-07-21 10:12:14,166 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 646c4734d454181f95516b751d1a6763 2023-07-21 10:12:14,170 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/namespace/646c4734d454181f95516b751d1a6763/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 10:12:14,171 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 646c4734d454181f95516b751d1a6763; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74993405, jitterRate=0.1174888163805008}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 10:12:14,171 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 646c4734d454181f95516b751d1a6763: 2023-07-21 10:12:14,177 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689934333342.646c4734d454181f95516b751d1a6763., pid=6, masterSystemTime=1689934334116 2023-07-21 10:12:14,188 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689934333342.646c4734d454181f95516b751d1a6763. 2023-07-21 10:12:14,189 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689934333342.646c4734d454181f95516b751d1a6763. 2023-07-21 10:12:14,189 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=646c4734d454181f95516b751d1a6763, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:14,189 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689934333342.646c4734d454181f95516b751d1a6763.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689934334188"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689934334188"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689934334188"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689934334188"}]},"ts":"1689934334188"} 2023-07-21 10:12:14,206 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-21 10:12:14,206 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 646c4734d454181f95516b751d1a6763, server=jenkins-hbase17.apache.org,36809,1689934328937 in 244 msec 2023-07-21 10:12:14,211 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-21 10:12:14,213 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=646c4734d454181f95516b751d1a6763, ASSIGN in 427 msec 2023-07-21 10:12:14,215 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 10:12:14,215 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934334215"}]},"ts":"1689934334215"} 2023-07-21 10:12:14,217 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-21 10:12:14,221 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 10:12:14,227 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 877 msec 2023-07-21 10:12:14,267 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-21 10:12:14,268 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-21 10:12:14,268 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 10:12:14,290 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:12:14,298 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:38814, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:12:14,313 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-21 10:12:14,349 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-21 10:12:14,360 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 52 msec 2023-07-21 10:12:14,370 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-21 10:12:14,386 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-21 10:12:14,396 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 26 msec 2023-07-21 10:12:14,406 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-21 10:12:14,407 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-21 10:12:14,410 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 5.253sec 2023-07-21 10:12:14,416 INFO [master/jenkins-hbase17:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-21 10:12:14,418 INFO [master/jenkins-hbase17:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-21 10:12:14,418 INFO [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-21 10:12:14,420 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,35385,1689934327246-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-21 10:12:14,421 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,35385,1689934327246-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-21 10:12:14,449 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-21 10:12:14,452 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-21 10:12:14,454 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 10:12:14,456 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 10:12:14,458 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-21 10:12:14,464 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/hbase/acl/cc2f998fff196f1e13865138a480e54b 2023-07-21 10:12:14,464 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-21 10:12:14,465 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/hbase/acl/cc2f998fff196f1e13865138a480e54b empty. 2023-07-21 10:12:14,472 DEBUG [Listener at localhost.localdomain/37301] zookeeper.ReadOnlyZKClient(139): Connect 0x73e2c378 to 127.0.0.1:56971 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:12:14,474 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/hbase/acl/cc2f998fff196f1e13865138a480e54b 2023-07-21 10:12:14,474 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-21 10:12:14,492 DEBUG [Listener at localhost.localdomain/37301] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@123418ae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:12:14,565 DEBUG [hconnection-0x194c682a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:12:14,576 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-21 10:12:14,598 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-21 10:12:14,600 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:48218, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:12:14,601 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => cc2f998fff196f1e13865138a480e54b, NAME => 'hbase:acl,,1689934334443.cc2f998fff196f1e13865138a480e54b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp 2023-07-21 10:12:14,608 INFO [Listener at localhost.localdomain/37301] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase17.apache.org,35385,1689934327246 2023-07-21 10:12:14,608 INFO [Listener at localhost.localdomain/37301] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-21 10:12:14,608 INFO [Listener at localhost.localdomain/37301] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/test.cache.data in system properties and HBase conf 2023-07-21 10:12:14,608 INFO [Listener at localhost.localdomain/37301] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/hadoop.tmp.dir in system properties and HBase conf 2023-07-21 10:12:14,608 INFO [Listener at localhost.localdomain/37301] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/hadoop.log.dir in system properties and HBase conf 2023-07-21 10:12:14,608 INFO [Listener at localhost.localdomain/37301] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-21 10:12:14,608 INFO [Listener at localhost.localdomain/37301] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-21 10:12:14,608 INFO [Listener at localhost.localdomain/37301] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-21 10:12:14,608 INFO [Listener at localhost.localdomain/37301] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-21 10:12:14,609 INFO [Listener at localhost.localdomain/37301] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-21 10:12:14,609 INFO [Listener at localhost.localdomain/37301] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-21 10:12:14,609 INFO [Listener at localhost.localdomain/37301] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-21 10:12:14,609 INFO [Listener at localhost.localdomain/37301] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-21 10:12:14,609 INFO [Listener at localhost.localdomain/37301] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-21 10:12:14,609 INFO [Listener at localhost.localdomain/37301] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-21 10:12:14,609 INFO [Listener at localhost.localdomain/37301] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-21 10:12:14,609 INFO [Listener at localhost.localdomain/37301] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-21 10:12:14,610 INFO [Listener at localhost.localdomain/37301] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/nfs.dump.dir in system properties and HBase conf 2023-07-21 10:12:14,611 INFO [Listener at localhost.localdomain/37301] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/java.io.tmpdir in system properties and HBase conf 2023-07-21 10:12:14,611 INFO [Listener at localhost.localdomain/37301] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-21 10:12:14,611 INFO [Listener at localhost.localdomain/37301] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-21 10:12:14,611 INFO [Listener at localhost.localdomain/37301] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-21 10:12:14,689 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689934334443.cc2f998fff196f1e13865138a480e54b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:12:14,690 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing cc2f998fff196f1e13865138a480e54b, disabling compactions & flushes 2023-07-21 10:12:14,690 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689934334443.cc2f998fff196f1e13865138a480e54b. 2023-07-21 10:12:14,690 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689934334443.cc2f998fff196f1e13865138a480e54b. 2023-07-21 10:12:14,690 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689934334443.cc2f998fff196f1e13865138a480e54b. after waiting 0 ms 2023-07-21 10:12:14,690 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689934334443.cc2f998fff196f1e13865138a480e54b. 2023-07-21 10:12:14,690 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689934334443.cc2f998fff196f1e13865138a480e54b. 2023-07-21 10:12:14,690 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for cc2f998fff196f1e13865138a480e54b: 2023-07-21 10:12:14,709 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 10:12:14,711 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689934334443.cc2f998fff196f1e13865138a480e54b.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689934334711"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934334711"}]},"ts":"1689934334711"} 2023-07-21 10:12:14,718 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-21 10:12:14,724 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 10:12:14,724 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934334724"}]},"ts":"1689934334724"} 2023-07-21 10:12:14,734 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-21 10:12:14,776 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-21 10:12:14,937 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-21 10:12:14,938 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 10:12:14,938 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 10:12:14,938 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 10:12:14,938 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 10:12:14,939 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=cc2f998fff196f1e13865138a480e54b, ASSIGN}] 2023-07-21 10:12:14,957 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=cc2f998fff196f1e13865138a480e54b, ASSIGN 2023-07-21 10:12:14,963 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=cc2f998fff196f1e13865138a480e54b, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,37151,1689934329015; forceNewPlan=false, retain=false 2023-07-21 10:12:15,077 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-21 10:12:15,116 INFO [jenkins-hbase17:35385] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-21 10:12:15,122 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=cc2f998fff196f1e13865138a480e54b, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:15,122 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689934334443.cc2f998fff196f1e13865138a480e54b.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689934335122"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934335122"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934335122"}]},"ts":"1689934335122"} 2023-07-21 10:12:15,130 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure cc2f998fff196f1e13865138a480e54b, server=jenkins-hbase17.apache.org,37151,1689934329015}] 2023-07-21 10:12:15,322 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:15,323 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-21 10:12:15,340 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:49760, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-21 10:12:15,368 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689934334443.cc2f998fff196f1e13865138a480e54b. 2023-07-21 10:12:15,368 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cc2f998fff196f1e13865138a480e54b, NAME => 'hbase:acl,,1689934334443.cc2f998fff196f1e13865138a480e54b.', STARTKEY => '', ENDKEY => ''} 2023-07-21 10:12:15,369 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689934334443.cc2f998fff196f1e13865138a480e54b. service=AccessControlService 2023-07-21 10:12:15,369 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:12:15,369 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl cc2f998fff196f1e13865138a480e54b 2023-07-21 10:12:15,370 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689934334443.cc2f998fff196f1e13865138a480e54b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:12:15,370 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for cc2f998fff196f1e13865138a480e54b 2023-07-21 10:12:15,370 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for cc2f998fff196f1e13865138a480e54b 2023-07-21 10:12:15,379 INFO [StoreOpener-cc2f998fff196f1e13865138a480e54b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region cc2f998fff196f1e13865138a480e54b 2023-07-21 10:12:15,383 DEBUG [StoreOpener-cc2f998fff196f1e13865138a480e54b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/acl/cc2f998fff196f1e13865138a480e54b/l 2023-07-21 10:12:15,383 DEBUG [StoreOpener-cc2f998fff196f1e13865138a480e54b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/acl/cc2f998fff196f1e13865138a480e54b/l 2023-07-21 10:12:15,384 INFO [StoreOpener-cc2f998fff196f1e13865138a480e54b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cc2f998fff196f1e13865138a480e54b columnFamilyName l 2023-07-21 10:12:15,385 INFO [StoreOpener-cc2f998fff196f1e13865138a480e54b-1] regionserver.HStore(310): Store=cc2f998fff196f1e13865138a480e54b/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:12:15,387 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/acl/cc2f998fff196f1e13865138a480e54b 2023-07-21 10:12:15,393 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/acl/cc2f998fff196f1e13865138a480e54b 2023-07-21 10:12:15,423 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for cc2f998fff196f1e13865138a480e54b 2023-07-21 10:12:15,450 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/acl/cc2f998fff196f1e13865138a480e54b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 10:12:15,451 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened cc2f998fff196f1e13865138a480e54b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61217123, jitterRate=-0.08779378235340118}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 10:12:15,452 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for cc2f998fff196f1e13865138a480e54b: 2023-07-21 10:12:15,455 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689934334443.cc2f998fff196f1e13865138a480e54b., pid=11, masterSystemTime=1689934335322 2023-07-21 10:12:15,469 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689934334443.cc2f998fff196f1e13865138a480e54b. 2023-07-21 10:12:15,469 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689934334443.cc2f998fff196f1e13865138a480e54b. 2023-07-21 10:12:15,477 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=cc2f998fff196f1e13865138a480e54b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:15,477 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689934334443.cc2f998fff196f1e13865138a480e54b.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689934335477"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689934335477"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689934335477"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689934335477"}]},"ts":"1689934335477"} 2023-07-21 10:12:15,512 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-21 10:12:15,512 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure cc2f998fff196f1e13865138a480e54b, server=jenkins-hbase17.apache.org,37151,1689934329015 in 366 msec 2023-07-21 10:12:15,519 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-21 10:12:15,519 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=cc2f998fff196f1e13865138a480e54b, ASSIGN in 573 msec 2023-07-21 10:12:15,521 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 10:12:15,522 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934335521"}]},"ts":"1689934335521"} 2023-07-21 10:12:15,533 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-21 10:12:15,543 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 10:12:15,548 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 1.0930 sec 2023-07-21 10:12:15,577 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-21 10:12:15,577 INFO [master/jenkins-hbase17:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-21 10:12:15,587 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-21 10:12:16,524 WARN [Thread-385] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 10:12:16,888 INFO [Thread-385] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 10:12:16,896 INFO [Thread-385] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/java.io.tmpdir/Jetty_jenkins.hbase17_apache_org_40137_jobhistory____.8c6p3m/webapp 2023-07-21 10:12:17,081 INFO [Thread-385] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-21 10:12:17,081 INFO [Thread-385] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-21 10:12:17,082 INFO [Thread-385] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-21 10:12:17,085 INFO [Thread-385] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-21 10:12:17,212 INFO [Thread-385] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 10:12:17,470 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:12:17,471 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-21 10:12:17,472 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:12:17,472 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-21 10:12:17,472 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-21 10:12:17,472 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-21 10:12:17,473 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:12:17,473 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-21 10:12:17,473 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-21 10:12:17,473 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-21 10:12:17,616 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-21 10:12:17,619 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-21 10:12:17,621 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-21 10:12:17,700 INFO [Thread-385] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 10:12:18,349 INFO [Thread-385] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-21 10:12:18,486 INFO [Thread-385] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:40137 2023-07-21 10:12:18,648 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 10:12:19,531 WARN [Listener at jenkins-hbase17.apache.org/46281] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 10:12:19,666 WARN [Listener at jenkins-hbase17.apache.org/46281] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-21 10:12:19,668 INFO [Listener at jenkins-hbase17.apache.org/46281] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 10:12:19,679 INFO [Listener at jenkins-hbase17.apache.org/46281] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/java.io.tmpdir/Jetty_jenkins.hbase17_apache_org_44537_cluster____.wtr08x/webapp 2023-07-21 10:12:19,817 INFO [Listener at jenkins-hbase17.apache.org/46281] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-21 10:12:19,817 INFO [Listener at jenkins-hbase17.apache.org/46281] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-21 10:12:19,818 INFO [Listener at jenkins-hbase17.apache.org/46281] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-21 10:12:19,820 INFO [Listener at jenkins-hbase17.apache.org/46281] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-21 10:12:19,837 INFO [Listener at jenkins-hbase17.apache.org/46281] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 10:12:20,126 INFO [Listener at jenkins-hbase17.apache.org/46281] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 10:12:20,347 INFO [Listener at jenkins-hbase17.apache.org/46281] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 10:12:20,373 INFO [Listener at jenkins-hbase17.apache.org/46281] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:44537 2023-07-21 10:12:21,194 WARN [Listener at jenkins-hbase17.apache.org/37381] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 10:12:21,250 WARN [Listener at jenkins-hbase17.apache.org/37381] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-21 10:12:21,250 INFO [Listener at jenkins-hbase17.apache.org/37381] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 10:12:21,260 INFO [Listener at jenkins-hbase17.apache.org/37381] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/java.io.tmpdir/Jetty_jenkins.hbase17_apache_org_33721_node____y8p6ww/webapp 2023-07-21 10:12:21,334 INFO [Listener at jenkins-hbase17.apache.org/37381] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-21 10:12:21,335 INFO [Listener at jenkins-hbase17.apache.org/37381] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-21 10:12:21,335 INFO [Listener at jenkins-hbase17.apache.org/37381] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-21 10:12:21,335 INFO [Listener at jenkins-hbase17.apache.org/37381] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-21 10:12:21,348 INFO [Listener at jenkins-hbase17.apache.org/37381] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 10:12:21,385 INFO [Listener at jenkins-hbase17.apache.org/37381] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 10:12:21,664 INFO [Listener at jenkins-hbase17.apache.org/37381] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 10:12:21,682 INFO [Listener at jenkins-hbase17.apache.org/37381] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:33721 2023-07-21 10:12:22,275 WARN [Listener at jenkins-hbase17.apache.org/42227] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 10:12:22,284 WARN [Listener at jenkins-hbase17.apache.org/42227] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-21 10:12:22,284 INFO [Listener at jenkins-hbase17.apache.org/42227] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 10:12:22,307 INFO [Listener at jenkins-hbase17.apache.org/42227] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/java.io.tmpdir/Jetty_jenkins.hbase17_apache_org_45331_node____77xguy/webapp 2023-07-21 10:12:22,369 INFO [Listener at jenkins-hbase17.apache.org/42227] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-21 10:12:22,369 INFO [Listener at jenkins-hbase17.apache.org/42227] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-21 10:12:22,369 INFO [Listener at jenkins-hbase17.apache.org/42227] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-21 10:12:22,370 INFO [Listener at jenkins-hbase17.apache.org/42227] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-21 10:12:22,383 INFO [Listener at jenkins-hbase17.apache.org/42227] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 10:12:22,400 INFO [Listener at jenkins-hbase17.apache.org/42227] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 10:12:22,506 INFO [Listener at jenkins-hbase17.apache.org/42227] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 10:12:22,524 INFO [Listener at jenkins-hbase17.apache.org/42227] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:45331 2023-07-21 10:12:22,583 INFO [Listener at jenkins-hbase17.apache.org/42227] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-21 10:12:22,585 INFO [Listener at jenkins-hbase17.apache.org/42227] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 10:12:22,692 INFO [Listener at jenkins-hbase17.apache.org/42227] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=704, OpenFileDescriptor=903, MaxFileDescriptor=60000, SystemLoadAverage=657, ProcessCount=187, AvailableMemoryMB=1469 2023-07-21 10:12:22,692 WARN [Listener at jenkins-hbase17.apache.org/42227] hbase.ResourceChecker(130): Thread=704 is superior to 500 2023-07-21 10:12:22,717 DEBUG [Listener at jenkins-hbase17.apache.org/42227] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-21 10:12:22,724 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:60190, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-21 10:12:22,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-21 10:12:22,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-21 10:12:22,742 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 10:12:22,744 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-21 10:12:22,746 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 10:12:22,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-21 10:12:22,752 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportWithTargetName/1085af717993116c6838493c8bd8631f 2023-07-21 10:12:22,753 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportWithTargetName/fa50a854452196fb1f8335e029f4b328 2023-07-21 10:12:22,754 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportWithTargetName/1085af717993116c6838493c8bd8631f empty. 2023-07-21 10:12:22,757 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportWithTargetName/1085af717993116c6838493c8bd8631f 2023-07-21 10:12:22,757 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportWithTargetName/fa50a854452196fb1f8335e029f4b328 empty. 2023-07-21 10:12:22,762 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportWithTargetName/fa50a854452196fb1f8335e029f4b328 2023-07-21 10:12:22,762 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-21 10:12:22,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-21 10:12:22,865 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-21 10:12:22,869 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1085af717993116c6838493c8bd8631f, NAME => 'testtb-testExportWithTargetName,,1689934342732.1085af717993116c6838493c8bd8631f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp 2023-07-21 10:12:22,870 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => fa50a854452196fb1f8335e029f4b328, NAME => 'testtb-testExportWithTargetName,1,1689934342732.fa50a854452196fb1f8335e029f4b328.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp 2023-07-21 10:12:22,961 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689934342732.fa50a854452196fb1f8335e029f4b328.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:12:22,961 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing fa50a854452196fb1f8335e029f4b328, disabling compactions & flushes 2023-07-21 10:12:22,961 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689934342732.fa50a854452196fb1f8335e029f4b328. 2023-07-21 10:12:22,961 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689934342732.fa50a854452196fb1f8335e029f4b328. 2023-07-21 10:12:22,961 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689934342732.fa50a854452196fb1f8335e029f4b328. after waiting 0 ms 2023-07-21 10:12:22,961 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689934342732.fa50a854452196fb1f8335e029f4b328. 2023-07-21 10:12:22,961 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689934342732.fa50a854452196fb1f8335e029f4b328. 2023-07-21 10:12:22,961 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for fa50a854452196fb1f8335e029f4b328: 2023-07-21 10:12:23,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-21 10:12:23,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-21 10:12:23,363 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689934342732.1085af717993116c6838493c8bd8631f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:12:23,363 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 1085af717993116c6838493c8bd8631f, disabling compactions & flushes 2023-07-21 10:12:23,363 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689934342732.1085af717993116c6838493c8bd8631f. 2023-07-21 10:12:23,364 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689934342732.1085af717993116c6838493c8bd8631f. 2023-07-21 10:12:23,364 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689934342732.1085af717993116c6838493c8bd8631f. after waiting 0 ms 2023-07-21 10:12:23,364 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689934342732.1085af717993116c6838493c8bd8631f. 2023-07-21 10:12:23,364 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689934342732.1085af717993116c6838493c8bd8631f. 2023-07-21 10:12:23,364 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 1085af717993116c6838493c8bd8631f: 2023-07-21 10:12:23,368 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 10:12:23,370 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689934342732.fa50a854452196fb1f8335e029f4b328.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689934343369"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934343369"}]},"ts":"1689934343369"} 2023-07-21 10:12:23,370 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689934342732.1085af717993116c6838493c8bd8631f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689934343369"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934343369"}]},"ts":"1689934343369"} 2023-07-21 10:12:23,432 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-21 10:12:23,434 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 10:12:23,434 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934343434"}]},"ts":"1689934343434"} 2023-07-21 10:12:23,437 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-21 10:12:23,450 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-21 10:12:23,453 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 10:12:23,453 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 10:12:23,453 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 10:12:23,453 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 10:12:23,453 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1085af717993116c6838493c8bd8631f, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fa50a854452196fb1f8335e029f4b328, ASSIGN}] 2023-07-21 10:12:23,457 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1085af717993116c6838493c8bd8631f, ASSIGN 2023-07-21 10:12:23,458 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fa50a854452196fb1f8335e029f4b328, ASSIGN 2023-07-21 10:12:23,460 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1085af717993116c6838493c8bd8631f, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,37151,1689934329015; forceNewPlan=false, retain=false 2023-07-21 10:12:23,460 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fa50a854452196fb1f8335e029f4b328, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,36809,1689934328937; forceNewPlan=false, retain=false 2023-07-21 10:12:23,611 INFO [jenkins-hbase17:35385] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-21 10:12:23,614 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=1085af717993116c6838493c8bd8631f, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:23,614 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=fa50a854452196fb1f8335e029f4b328, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:23,614 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689934342732.1085af717993116c6838493c8bd8631f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689934343614"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934343614"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934343614"}]},"ts":"1689934343614"} 2023-07-21 10:12:23,614 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689934342732.fa50a854452196fb1f8335e029f4b328.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689934343614"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934343614"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934343614"}]},"ts":"1689934343614"} 2023-07-21 10:12:23,621 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 1085af717993116c6838493c8bd8631f, server=jenkins-hbase17.apache.org,37151,1689934329015}] 2023-07-21 10:12:23,624 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure fa50a854452196fb1f8335e029f4b328, server=jenkins-hbase17.apache.org,36809,1689934328937}] 2023-07-21 10:12:23,781 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689934342732.1085af717993116c6838493c8bd8631f. 2023-07-21 10:12:23,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1085af717993116c6838493c8bd8631f, NAME => 'testtb-testExportWithTargetName,,1689934342732.1085af717993116c6838493c8bd8631f.', STARTKEY => '', ENDKEY => '1'} 2023-07-21 10:12:23,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689934342732.1085af717993116c6838493c8bd8631f. service=AccessControlService 2023-07-21 10:12:23,782 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:12:23,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 1085af717993116c6838493c8bd8631f 2023-07-21 10:12:23,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689934342732.1085af717993116c6838493c8bd8631f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:12:23,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 1085af717993116c6838493c8bd8631f 2023-07-21 10:12:23,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 1085af717993116c6838493c8bd8631f 2023-07-21 10:12:23,784 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689934342732.fa50a854452196fb1f8335e029f4b328. 2023-07-21 10:12:23,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fa50a854452196fb1f8335e029f4b328, NAME => 'testtb-testExportWithTargetName,1,1689934342732.fa50a854452196fb1f8335e029f4b328.', STARTKEY => '1', ENDKEY => ''} 2023-07-21 10:12:23,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689934342732.fa50a854452196fb1f8335e029f4b328. service=AccessControlService 2023-07-21 10:12:23,784 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:12:23,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName fa50a854452196fb1f8335e029f4b328 2023-07-21 10:12:23,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689934342732.fa50a854452196fb1f8335e029f4b328.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:12:23,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for fa50a854452196fb1f8335e029f4b328 2023-07-21 10:12:23,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for fa50a854452196fb1f8335e029f4b328 2023-07-21 10:12:23,785 INFO [StoreOpener-1085af717993116c6838493c8bd8631f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1085af717993116c6838493c8bd8631f 2023-07-21 10:12:23,786 INFO [StoreOpener-fa50a854452196fb1f8335e029f4b328-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fa50a854452196fb1f8335e029f4b328 2023-07-21 10:12:23,787 DEBUG [StoreOpener-1085af717993116c6838493c8bd8631f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportWithTargetName/1085af717993116c6838493c8bd8631f/cf 2023-07-21 10:12:23,787 DEBUG [StoreOpener-1085af717993116c6838493c8bd8631f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportWithTargetName/1085af717993116c6838493c8bd8631f/cf 2023-07-21 10:12:23,789 DEBUG [StoreOpener-fa50a854452196fb1f8335e029f4b328-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportWithTargetName/fa50a854452196fb1f8335e029f4b328/cf 2023-07-21 10:12:23,789 DEBUG [StoreOpener-fa50a854452196fb1f8335e029f4b328-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportWithTargetName/fa50a854452196fb1f8335e029f4b328/cf 2023-07-21 10:12:23,791 INFO [StoreOpener-fa50a854452196fb1f8335e029f4b328-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fa50a854452196fb1f8335e029f4b328 columnFamilyName cf 2023-07-21 10:12:23,791 INFO [StoreOpener-1085af717993116c6838493c8bd8631f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1085af717993116c6838493c8bd8631f columnFamilyName cf 2023-07-21 10:12:23,794 INFO [StoreOpener-fa50a854452196fb1f8335e029f4b328-1] regionserver.HStore(310): Store=fa50a854452196fb1f8335e029f4b328/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:12:23,800 INFO [StoreOpener-1085af717993116c6838493c8bd8631f-1] regionserver.HStore(310): Store=1085af717993116c6838493c8bd8631f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:12:23,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportWithTargetName/fa50a854452196fb1f8335e029f4b328 2023-07-21 10:12:23,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportWithTargetName/1085af717993116c6838493c8bd8631f 2023-07-21 10:12:23,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportWithTargetName/fa50a854452196fb1f8335e029f4b328 2023-07-21 10:12:23,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportWithTargetName/1085af717993116c6838493c8bd8631f 2023-07-21 10:12:23,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 1085af717993116c6838493c8bd8631f 2023-07-21 10:12:23,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for fa50a854452196fb1f8335e029f4b328 2023-07-21 10:12:23,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportWithTargetName/1085af717993116c6838493c8bd8631f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 10:12:23,819 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 1085af717993116c6838493c8bd8631f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63330090, jitterRate=-0.05630812048912048}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 10:12:23,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 1085af717993116c6838493c8bd8631f: 2023-07-21 10:12:23,822 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689934342732.1085af717993116c6838493c8bd8631f., pid=15, masterSystemTime=1689934343775 2023-07-21 10:12:23,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportWithTargetName/fa50a854452196fb1f8335e029f4b328/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 10:12:23,823 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened fa50a854452196fb1f8335e029f4b328; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62721862, jitterRate=-0.06537142395973206}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 10:12:23,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for fa50a854452196fb1f8335e029f4b328: 2023-07-21 10:12:23,825 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689934342732.fa50a854452196fb1f8335e029f4b328., pid=16, masterSystemTime=1689934343778 2023-07-21 10:12:23,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689934342732.1085af717993116c6838493c8bd8631f. 2023-07-21 10:12:23,825 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689934342732.1085af717993116c6838493c8bd8631f. 2023-07-21 10:12:23,826 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=1085af717993116c6838493c8bd8631f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:23,826 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689934342732.1085af717993116c6838493c8bd8631f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689934343826"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689934343826"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689934343826"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689934343826"}]},"ts":"1689934343826"} 2023-07-21 10:12:23,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689934342732.fa50a854452196fb1f8335e029f4b328. 2023-07-21 10:12:23,827 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689934342732.fa50a854452196fb1f8335e029f4b328. 2023-07-21 10:12:23,829 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=fa50a854452196fb1f8335e029f4b328, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:23,830 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689934342732.fa50a854452196fb1f8335e029f4b328.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689934343828"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689934343828"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689934343828"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689934343828"}]},"ts":"1689934343828"} 2023-07-21 10:12:23,834 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-21 10:12:23,834 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 1085af717993116c6838493c8bd8631f, server=jenkins-hbase17.apache.org,37151,1689934329015 in 209 msec 2023-07-21 10:12:23,837 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-21 10:12:23,838 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1085af717993116c6838493c8bd8631f, ASSIGN in 381 msec 2023-07-21 10:12:23,839 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure fa50a854452196fb1f8335e029f4b328, server=jenkins-hbase17.apache.org,36809,1689934328937 in 209 msec 2023-07-21 10:12:23,841 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=12 2023-07-21 10:12:23,842 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fa50a854452196fb1f8335e029f4b328, ASSIGN in 385 msec 2023-07-21 10:12:23,842 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 10:12:23,843 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934343842"}]},"ts":"1689934343842"} 2023-07-21 10:12:23,844 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-21 10:12:23,847 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 10:12:23,853 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-21 10:12:23,860 DEBUG [PEWorker-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:12:23,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-21 10:12:23,868 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:58962, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:12:23,873 DEBUG [hconnection-0x48e94f2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:12:23,876 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:34856, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2023-07-21 10:12:23,885 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37151] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-21 10:12:23,916 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-21 10:12:23,916 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-21 10:12:23,916 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-21 10:12:23,916 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 10:12:23,916 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-21 10:12:23,923 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:12:23,929 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-21 10:12:23,930 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-21 10:12:23,931 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-21 10:12:23,931 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-21 10:12:23,934 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 1.1970 sec 2023-07-21 10:12:24,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-21 10:12:24,870 INFO [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-21 10:12:24,875 DEBUG [Listener at jenkins-hbase17.apache.org/42227] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-21 10:12:24,876 DEBUG [Listener at jenkins-hbase17.apache.org/42227] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689934342732.1085af717993116c6838493c8bd8631f. 2023-07-21 10:12:24,880 INFO [Listener at jenkins-hbase17.apache.org/42227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 10:12:24,916 DEBUG [hconnection-0x194c682a-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:12:24,920 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:58968, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:12:24,929 DEBUG [hconnection-0x194c682a-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:12:24,935 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:56488, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:12:24,975 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-21 10:12:24,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689934344975 (current time:1689934344975). 2023-07-21 10:12:24,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 10:12:24,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] zookeeper.ReadOnlyZKClient(139): Connect 0x579fc7b8 to 127.0.0.1:56971 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:12:24,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24046f19, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:12:24,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:12:25,005 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:34858, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:12:25,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x579fc7b8 to 127.0.0.1:56971 2023-07-21 10:12:25,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:12:25,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] zookeeper.ReadOnlyZKClient(139): Connect 0x7f5681ed to 127.0.0.1:56971 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:12:25,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5cb47b3b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:12:25,026 DEBUG [hconnection-0x26a1e179-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:12:25,028 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:34866, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:12:25,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:12:25,041 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:58970, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:12:25,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7f5681ed to 127.0.0.1:56971 2023-07-21 10:12:25,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:12:25,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-21 10:12:25,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 10:12:25,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-21 10:12:25,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-21 10:12:25,099 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-21 10:12:25,100 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689934945100 2023-07-21 10:12:25,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-21 10:12:25,102 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-21 10:12:25,107 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-21 10:12:25,108 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-21 10:12:25,111 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 10:12:25,111 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 10:12:25,119 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 19 msec 2023-07-21 10:12:25,122 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-21 10:12:25,124 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689934945124 2023-07-21 10:12:25,168 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,168 INFO [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-21 10:12:25,168 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:12:25,170 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-21 10:12:25,170 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-21 10:12:25,171 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,171 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,211 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:12:25,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-21 10:12:25,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:12:25,218 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 10:12:25,350 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:25,350 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:25,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:25,350 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:25,350 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:25,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:25,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:25,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:25,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:25,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:25,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,351 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:25,352 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:25,352 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,352 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,352 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-21 10:12:25,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-21 10:12:25,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-21 10:12:25,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,353 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-21 10:12:25,353 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:25,354 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 10:12:25,355 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-21 10:12:25,367 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-21 10:12:25,367 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,367 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,367 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,368 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-21 10:12:25,368 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:12:25,368 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-21 10:12:25,370 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-21 10:12:25,370 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-21 10:12:25,370 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:12:25,370 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:12:25,372 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-21 10:12:25,370 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-21 10:12:25,373 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-21 10:12:25,373 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-21 10:12:25,374 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-21 10:12:25,374 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,38751,1689934329069' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-21 10:12:25,374 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36809,1689934328937' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-21 10:12:25,374 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,37151,1689934329015' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-21 10:12:25,396 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,396 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,396 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:25,397 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:25,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:25,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:12:25,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:12:25,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:12:25,400 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,400 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,400 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:12:25,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:12:25,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,402 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,402 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:12:25,402 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,402 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:12:25,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:25,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:25,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:25,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:12:25,408 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,36809,1689934328937' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-21 10:12:25,409 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5fd8e51e[Count = 1] remaining members to acquire global barrier 2023-07-21 10:12:25,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:25,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:12:25,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:12:25,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:12:25,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:12:25,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,418 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:12:25,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:25,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:25,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-21 10:12:25,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:12:25,421 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 10:12:25,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:25,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:12:25,422 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,37151,1689934329015' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-21 10:12:25,422 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5fd8e51e[Count = 0] remaining members to acquire global barrier 2023-07-21 10:12:25,422 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-21 10:12:25,422 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,426 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:25,428 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,432 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:25,432 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 10:12:25,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,432 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-21 10:12:25,433 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:12:25,434 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:12:25,434 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689934342732.1085af717993116c6838493c8bd8631f. 2023-07-21 10:12:25,434 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689934342732.1085af717993116c6838493c8bd8631f. started... 2023-07-21 10:12:25,436 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,436 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,436 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1085af717993116c6838493c8bd8631f: 2023-07-21 10:12:25,440 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-21 10:12:25,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,441 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:12:25,441 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-21 10:12:25,441 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:12:25,441 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-21 10:12:25,441 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,38751,1689934329069' in zk 2023-07-21 10:12:25,442 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689934342732.1085af717993116c6838493c8bd8631f.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,444 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-21 10:12:25,444 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:12:25,445 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-21 10:12:25,447 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689934342732.fa50a854452196fb1f8335e029f4b328. 2023-07-21 10:12:25,447 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689934342732.fa50a854452196fb1f8335e029f4b328. started... 2023-07-21 10:12:25,452 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fa50a854452196fb1f8335e029f4b328: 2023-07-21 10:12:25,452 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689934342732.fa50a854452196fb1f8335e029f4b328.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,457 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:12:25,457 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:12:25,462 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 10:12:25,462 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 10:12:25,565 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689934342732.1085af717993116c6838493c8bd8631f. completed. 2023-07-21 10:12:25,565 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689934342732.1085af717993116c6838493c8bd8631f. 2023-07-21 10:12:25,570 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:12:25,570 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:12:25,570 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:25,570 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-21 10:12:25,570 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,37151,1689934329015' in zk 2023-07-21 10:12:25,581 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-21 10:12:25,581 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:12:25,581 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-21 10:12:25,583 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:25,585 WARN [DataStreamer for file /user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName/region-manifest.fa50a854452196fb1f8335e029f4b328] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-21 10:12:25,585 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689934342732.fa50a854452196fb1f8335e029f4b328. completed. 2023-07-21 10:12:25,585 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689934342732.fa50a854452196fb1f8335e029f4b328. 2023-07-21 10:12:25,585 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:12:25,585 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:12:25,585 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:25,585 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-21 10:12:25,585 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,36809,1689934328937' in zk 2023-07-21 10:12:25,587 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-21 10:12:25,587 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:25,587 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:12:25,587 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-21 10:12:25,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:25,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:12:25,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:12:25,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:12:25,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:12:25,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:25,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:25,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:25,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:12:25,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:25,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:25,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:25,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase17.apache.org,37151,1689934329015': 2023-07-21 10:12:25,595 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,37151,1689934329015' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-21 10:12:25,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:25,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:12:25,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:12:25,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:12:25,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:12:25,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:25,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:25,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:25,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:12:25,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:25,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:25,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:25,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase17.apache.org,36809,1689934328937': 2023-07-21 10:12:25,600 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,36809,1689934328937' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-21 10:12:25,600 INFO [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-21 10:12:25,600 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 10:12:25,600 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 10:12:25,600 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,600 INFO [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 10:12:25,606 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,606 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,606 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:25,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:12:25,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:12:25,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,606 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,607 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:25,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:25,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:25,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:12:25,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:25,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:25,608 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,608 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:25,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,608 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:25,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,609 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:25,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:12:25,609 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:25,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:25,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:25,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:25,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:25,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:25,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:12:25,630 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:25,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,636 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:25,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:25,640 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:25,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:25,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:25,673 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:25,673 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,673 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:25,674 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:25,674 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,674 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:25,674 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,674 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:25,674 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:25,674 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName because node does not exist (not an error) 2023-07-21 10:12:25,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:25,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:25,674 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:25,674 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,674 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,674 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:25,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:25,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:25,676 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:25,676 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:25,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:25,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:25,678 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:12:25,678 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,684 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:25,684 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-21 10:12:25,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:25,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:25,684 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,684 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:25,685 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-21 10:12:25,686 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-21 10:12:25,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:25,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:25,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:25,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:25,721 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:12:25,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-21 10:12:25,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:12:25,726 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-21 10:12:25,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,760 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,864 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:26,226 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:12:26,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-21 10:12:26,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:12:26,237 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-21 10:12:26,774 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-21 10:12:26,774 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:26,775 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:26,775 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689934345102Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689934345752 (+650 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689934345752Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689934345752Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689934345790 (+38 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689934345849 (+59 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689934346774 (+925 ms) 2023-07-21 10:12:26,778 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-21 10:12:26,783 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 1.6740 sec 2023-07-21 10:12:27,237 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:12:27,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-21 10:12:27,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 10:12:27,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37151] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689934342732.1085af717993116c6838493c8bd8631f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 10:12:27,256 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36809] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689934342732.fa50a854452196fb1f8335e029f4b328. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 10:12:27,261 DEBUG [Listener at jenkins-hbase17.apache.org/42227] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-21 10:12:27,261 DEBUG [Listener at jenkins-hbase17.apache.org/42227] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689934342732.1085af717993116c6838493c8bd8631f. 2023-07-21 10:12:27,261 INFO [Listener at jenkins-hbase17.apache.org/42227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 10:12:27,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-21 10:12:27,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689934347279 (current time:1689934347279). 2023-07-21 10:12:27,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 10:12:27,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] zookeeper.ReadOnlyZKClient(139): Connect 0x449e77a9 to 127.0.0.1:56971 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:12:27,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21aad1f2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:12:27,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:12:27,311 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:34874, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:12:27,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x449e77a9 to 127.0.0.1:56971 2023-07-21 10:12:27,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:12:27,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] zookeeper.ReadOnlyZKClient(139): Connect 0x56da58f3 to 127.0.0.1:56971 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:12:27,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@614e5ebe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:12:27,340 DEBUG [hconnection-0x161c3624-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:12:27,345 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:34882, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:12:27,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:12:27,358 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:58980, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:12:27,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x56da58f3 to 127.0.0.1:56971 2023-07-21 10:12:27,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:12:27,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-21 10:12:27,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 10:12:27,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-21 10:12:27,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-21 10:12:27,372 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-21 10:12:27,374 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689934947374 2023-07-21 10:12:27,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-21 10:12:27,374 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-21 10:12:27,377 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 10:12:27,378 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 10:12:27,379 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-21 10:12:27,381 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-21 10:12:27,386 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 12 msec 2023-07-21 10:12:27,387 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-21 10:12:27,389 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689934947389 2023-07-21 10:12:27,431 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-21 10:12:27,431 INFO [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-21 10:12:27,431 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:12:27,433 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-21 10:12:27,433 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-21 10:12:27,470 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 10:12:27,470 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 10:12:27,471 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:27,471 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:27,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:27,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:27,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:27,471 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:27,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:27,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:27,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:27,471 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:27,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 10:12:27,473 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:27,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 10:12:27,473 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 10:12:27,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 10:12:27,473 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:27,473 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 10:12:27,473 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 10:12:27,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-21 10:12:27,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 10:12:27,474 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-21 10:12:27,474 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:27,474 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 10:12:27,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-21 10:12:27,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 10:12:27,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-21 10:12:27,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 10:12:27,475 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-21 10:12:27,475 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-21 10:12:27,476 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-21 10:12:27,476 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-21 10:12:27,476 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:12:27,480 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-21 10:12:27,480 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-21 10:12:27,480 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:12:27,481 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:12:27,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-21 10:12:27,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:12:27,483 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 10:12:27,483 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-21 10:12:27,485 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-21 10:12:27,485 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-21 10:12:27,485 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:12:27,485 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-21 10:12:27,487 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,37151,1689934329015' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-21 10:12:27,492 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-21 10:12:27,492 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-21 10:12:27,492 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-21 10:12:27,492 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-21 10:12:27,492 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36809,1689934328937' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-21 10:12:27,492 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,38751,1689934329069' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-21 10:12:27,493 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 10:12:27,493 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:27,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:27,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:12:27,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:12:27,494 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 10:12:27,494 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:27,494 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 10:12:27,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:12:27,495 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 10:12:27,495 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:12:27,495 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 10:12:27,495 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:12:27,496 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 10:12:27,496 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:12:27,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:12:27,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 10:12:27,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:27,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:27,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:27,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:12:27,501 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,37151,1689934329015' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-21 10:12:27,501 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6adfaf12[Count = 1] remaining members to acquire global barrier 2023-07-21 10:12:27,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:27,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:12:27,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:12:27,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:12:27,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:12:27,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 10:12:27,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:27,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:27,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:27,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:12:27,505 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,36809,1689934328937' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-21 10:12:27,505 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6adfaf12[Count = 0] remaining members to acquire global barrier 2023-07-21 10:12:27,505 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-21 10:12:27,505 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 10:12:27,510 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 10:12:27,510 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 10:12:27,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 10:12:27,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 10:12:27,510 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:27,510 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 10:12:27,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 10:12:27,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 10:12:27,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 10:12:27,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 10:12:27,511 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:27,511 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 10:12:27,511 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-21 10:12:27,512 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-21 10:12:27,512 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,38751,1689934329069' in zk 2023-07-21 10:12:27,511 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-21 10:12:27,511 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-21 10:12:27,512 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:12:27,512 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:12:27,512 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:12:27,512 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:12:27,512 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689934342732.fa50a854452196fb1f8335e029f4b328. 2023-07-21 10:12:27,512 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689934342732.1085af717993116c6838493c8bd8631f. 2023-07-21 10:12:27,512 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689934342732.fa50a854452196fb1f8335e029f4b328. started... 2023-07-21 10:12:27,512 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689934342732.1085af717993116c6838493c8bd8631f. started... 2023-07-21 10:12:27,520 INFO [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1085af717993116c6838493c8bd8631f 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-21 10:12:27,521 INFO [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.HRegion(2745): Flushing fa50a854452196fb1f8335e029f4b328 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-21 10:12:27,524 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-21 10:12:27,524 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:12:27,524 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-21 10:12:27,696 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:12:27,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-21 10:12:27,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:12:27,720 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 10:12:27,794 INFO [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230721df503f77f84a46d09cb8fd72fa73d1bd to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230721df503f77f84a46d09cb8fd72fa73d1bd 2023-07-21 10:12:27,794 INFO [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230721a15f69f8f433430ab73a8e9bdd1a8d43 to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230721a15f69f8f433430ab73a8e9bdd1a8d43 2023-07-21 10:12:28,033 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:12:28,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-21 10:12:28,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:12:28,038 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-21 10:12:28,234 INFO [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportWithTargetName/fa50a854452196fb1f8335e029f4b328/.tmp/cf/f245b625c14c4334b588f618aa8a9606 2023-07-21 10:12:28,236 INFO [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportWithTargetName/1085af717993116c6838493c8bd8631f/.tmp/cf/6fdd2110592d4e049c5dc6832124aa51 2023-07-21 10:12:28,252 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportWithTargetName/fa50a854452196fb1f8335e029f4b328/.tmp/cf/f245b625c14c4334b588f618aa8a9606 as hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportWithTargetName/fa50a854452196fb1f8335e029f4b328/cf/f245b625c14c4334b588f618aa8a9606 2023-07-21 10:12:28,252 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportWithTargetName/1085af717993116c6838493c8bd8631f/.tmp/cf/6fdd2110592d4e049c5dc6832124aa51 as hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportWithTargetName/1085af717993116c6838493c8bd8631f/cf/6fdd2110592d4e049c5dc6832124aa51 2023-07-21 10:12:28,263 INFO [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportWithTargetName/fa50a854452196fb1f8335e029f4b328/cf/f245b625c14c4334b588f618aa8a9606, entries=45, sequenceid=6, filesize=12.5 K 2023-07-21 10:12:28,266 INFO [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportWithTargetName/1085af717993116c6838493c8bd8631f/cf/6fdd2110592d4e049c5dc6832124aa51, entries=5, sequenceid=6, filesize=5.7 K 2023-07-21 10:12:28,268 INFO [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for fa50a854452196fb1f8335e029f4b328 in 755ms, sequenceid=6, compaction requested=false 2023-07-21 10:12:28,270 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-21 10:12:28,270 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fa50a854452196fb1f8335e029f4b328: 2023-07-21 10:12:28,271 INFO [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 1085af717993116c6838493c8bd8631f in 751ms, sequenceid=6, compaction requested=false 2023-07-21 10:12:28,272 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1085af717993116c6838493c8bd8631f: 2023-07-21 10:12:28,272 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689934342732.fa50a854452196fb1f8335e029f4b328.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-21 10:12:28,272 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:12:28,272 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689934342732.1085af717993116c6838493c8bd8631f.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-21 10:12:28,272 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportWithTargetName/fa50a854452196fb1f8335e029f4b328/cf/f245b625c14c4334b588f618aa8a9606] hfiles 2023-07-21 10:12:28,272 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:12:28,272 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportWithTargetName/fa50a854452196fb1f8335e029f4b328/cf/f245b625c14c4334b588f618aa8a9606 for snapshot=snaptb0-testExportWithTargetName 2023-07-21 10:12:28,272 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportWithTargetName/1085af717993116c6838493c8bd8631f/cf/6fdd2110592d4e049c5dc6832124aa51] hfiles 2023-07-21 10:12:28,273 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportWithTargetName/1085af717993116c6838493c8bd8631f/cf/6fdd2110592d4e049c5dc6832124aa51 for snapshot=snaptb0-testExportWithTargetName 2023-07-21 10:12:28,328 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689934342732.1085af717993116c6838493c8bd8631f. completed. 2023-07-21 10:12:28,328 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689934342732.1085af717993116c6838493c8bd8631f. 2023-07-21 10:12:28,328 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:12:28,328 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:12:28,328 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:28,328 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-21 10:12:28,328 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,37151,1689934329015' in zk 2023-07-21 10:12:28,331 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689934342732.fa50a854452196fb1f8335e029f4b328. completed. 2023-07-21 10:12:28,331 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689934342732.fa50a854452196fb1f8335e029f4b328. 2023-07-21 10:12:28,331 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:12:28,331 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:12:28,331 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:28,331 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-21 10:12:28,331 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,36809,1689934328937' in zk 2023-07-21 10:12:28,332 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-21 10:12:28,332 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:12:28,332 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:28,332 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-21 10:12:28,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:28,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:12:28,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:12:28,340 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:28,340 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-21 10:12:28,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:12:28,340 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:12:28,340 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-21 10:12:28,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:12:28,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 10:12:28,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:28,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:28,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:28,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:12:28,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 10:12:28,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:28,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:28,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:28,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase17.apache.org,37151,1689934329015': 2023-07-21 10:12:28,349 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,37151,1689934329015' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-21 10:12:28,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:28,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:12:28,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:12:28,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:12:28,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:12:28,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 10:12:28,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:28,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:28,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:28,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:12:28,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 10:12:28,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:28,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:28,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:28,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase17.apache.org,36809,1689934328937': 2023-07-21 10:12:28,360 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,36809,1689934328937' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-21 10:12:28,360 INFO [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-21 10:12:28,361 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 10:12:28,361 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 10:12:28,361 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-21 10:12:28,361 INFO [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 10:12:28,362 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 10:12:28,362 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 10:12:28,362 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 10:12:28,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 10:12:28,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 10:12:28,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 10:12:28,362 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:28,362 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:28,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 10:12:28,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:12:28,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:12:28,362 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 10:12:28,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 10:12:28,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 10:12:28,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 10:12:28,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:28,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:28,363 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:28,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:28,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:28,364 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:28,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 10:12:28,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:28,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:28,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 10:12:28,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:12:28,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 10:12:28,365 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:28,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 10:12:28,365 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:28,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:12:28,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 10:12:28,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:28,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:28,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:28,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:12:28,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 10:12:28,369 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:28,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:28,369 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:28,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:28,370 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:28,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:28,400 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:28,400 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:28,401 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:28,401 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-21 10:12:28,400 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 10:12:28,401 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:28,401 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:28,401 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 10:12:28,401 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:28,401 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 10:12:28,401 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:28,401 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:28,401 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 10:12:28,401 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 10:12:28,401 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-21 10:12:28,401 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-21 10:12:28,402 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-21 10:12:28,401 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:28,401 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:28,402 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:28,401 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:12:28,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:28,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:28,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:28,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:28,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:28,402 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:28,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:28,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:28,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:28,404 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230721df503f77f84a46d09cb8fd72fa73d1bd, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230721a15f69f8f433430ab73a8e9bdd1a8d43] mob files 2023-07-21 10:12:28,412 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230721df503f77f84a46d09cb8fd72fa73d1bd 2023-07-21 10:12:28,412 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230721a15f69f8f433430ab73a8e9bdd1a8d43 2023-07-21 10:12:28,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:28,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:28,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:28,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:28,481 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-21 10:12:28,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-21 10:12:28,538 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:12:28,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-21 10:12:28,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:12:28,540 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-21 10:12:28,580 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-21 10:12:28,700 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-21 10:12:28,700 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-21 10:12:28,700 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-21 10:12:28,701 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689934347374Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689934348480 (+1106 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689934348481 (+1 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689934348481Writing data manifest for snaptb0-testExportWithTargetName at 1689934348498 (+17 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689934348543 (+45 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689934348700 (+157 ms) 2023-07-21 10:12:28,704 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-21 10:12:28,707 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 1.3280 sec 2023-07-21 10:12:29,330 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 10:12:29,540 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:12:29,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-21 10:12:29,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 10:12:29,542 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934349542 2023-07-21 10:12:29,543 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost.localdomain:35937, tgtDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934349542, rawTgtDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934349542, srcFsUri=hdfs://localhost.localdomain:35937, srcDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f 2023-07-21 10:12:29,603 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:35937, inputRoot=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f 2023-07-21 10:12:29,604 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1747062792_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934349542, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934349542/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-21 10:12:29,604 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:35937, inputRoot=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f, snapshotDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-21 10:12:29,669 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934349542/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-21 10:12:30,059 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:30,060 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:30,061 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:30,062 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:30,062 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:30,063 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:30,063 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:30,198 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/hadoop-494286144233992557.jar 2023-07-21 10:12:30,198 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:30,199 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:30,200 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:30,201 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:30,202 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:30,203 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:30,203 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-21 10:12:30,204 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-21 10:12:30,205 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-21 10:12:30,206 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-21 10:12:30,207 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-21 10:12:30,208 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-21 10:12:30,209 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-21 10:12:30,209 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-21 10:12:30,210 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-21 10:12:30,211 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-21 10:12:30,217 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:12:30,217 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:12:30,218 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 10:12:30,219 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:12:30,220 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:12:30,220 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 10:12:30,221 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 10:12:31,727 WARN [Listener at jenkins-hbase17.apache.org/42227] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-21 10:12:31,735 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-21 10:12:31,747 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-21 10:12:32,423 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 10:12:32,425 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 10:12:32,759 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934340509_0001_000001 (auth:SIMPLE) 2023-07-21 10:12:39,184 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934340509_0001_000001 (auth:SIMPLE) 2023-07-21 10:12:41,731 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934340509_0001_000001 (auth:SIMPLE) 2023-07-21 10:12:45,969 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934340509_0001_000001 (auth:SIMPLE) 2023-07-21 10:12:45,996 WARN [ContainersLauncher #1] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689934340509_0001_01_000002 is : 143 2023-07-21 10:12:47,962 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-21 10:12:47,962 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-21 10:12:47,981 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-21 10:12:47,981 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-21 10:12:47,982 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-21 10:12:47,982 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1557406679_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-21 10:12:47,982 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-21 10:12:47,982 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-21 10:12:47,983 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1557406679_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934349542/.hbase-snapshot/testExportWithTargetName at hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934349542/.hbase-snapshot/testExportWithTargetName 2023-07-21 10:12:47,983 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934349542/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-21 10:12:47,983 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934349542/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-21 10:12:47,995 INFO [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-21 10:12:48,007 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportWithTargetName 2023-07-21 10:12:48,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-21 10:12:48,027 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934368027"}]},"ts":"1689934368027"} 2023-07-21 10:12:48,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-21 10:12:48,032 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-21 10:12:48,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-21 10:12:48,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-21 10:12:48,431 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-21 10:12:48,435 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1085af717993116c6838493c8bd8631f, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fa50a854452196fb1f8335e029f4b328, UNASSIGN}] 2023-07-21 10:12:48,439 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1085af717993116c6838493c8bd8631f, UNASSIGN 2023-07-21 10:12:48,439 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fa50a854452196fb1f8335e029f4b328, UNASSIGN 2023-07-21 10:12:48,440 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=fa50a854452196fb1f8335e029f4b328, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:48,440 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=1085af717993116c6838493c8bd8631f, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:48,441 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689934342732.fa50a854452196fb1f8335e029f4b328.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689934368440"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934368440"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934368440"}]},"ts":"1689934368440"} 2023-07-21 10:12:48,441 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689934342732.1085af717993116c6838493c8bd8631f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689934368440"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934368440"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934368440"}]},"ts":"1689934368440"} 2023-07-21 10:12:48,443 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure fa50a854452196fb1f8335e029f4b328, server=jenkins-hbase17.apache.org,36809,1689934328937}] 2023-07-21 10:12:48,446 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure 1085af717993116c6838493c8bd8631f, server=jenkins-hbase17.apache.org,37151,1689934329015}] 2023-07-21 10:12:48,605 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close fa50a854452196fb1f8335e029f4b328 2023-07-21 10:12:48,605 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 1085af717993116c6838493c8bd8631f 2023-07-21 10:12:48,605 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing fa50a854452196fb1f8335e029f4b328, disabling compactions & flushes 2023-07-21 10:12:48,605 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 1085af717993116c6838493c8bd8631f, disabling compactions & flushes 2023-07-21 10:12:48,605 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689934342732.fa50a854452196fb1f8335e029f4b328. 2023-07-21 10:12:48,605 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689934342732.1085af717993116c6838493c8bd8631f. 2023-07-21 10:12:48,605 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689934342732.fa50a854452196fb1f8335e029f4b328. 2023-07-21 10:12:48,605 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689934342732.1085af717993116c6838493c8bd8631f. 2023-07-21 10:12:48,605 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689934342732.fa50a854452196fb1f8335e029f4b328. after waiting 0 ms 2023-07-21 10:12:48,606 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689934342732.1085af717993116c6838493c8bd8631f. after waiting 0 ms 2023-07-21 10:12:48,606 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689934342732.fa50a854452196fb1f8335e029f4b328. 2023-07-21 10:12:48,606 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689934342732.1085af717993116c6838493c8bd8631f. 2023-07-21 10:12:48,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportWithTargetName/fa50a854452196fb1f8335e029f4b328/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 10:12:48,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-21 10:12:48,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:12:48,644 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689934342732.fa50a854452196fb1f8335e029f4b328. 2023-07-21 10:12:48,644 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for fa50a854452196fb1f8335e029f4b328: 2023-07-21 10:12:48,647 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed fa50a854452196fb1f8335e029f4b328 2023-07-21 10:12:48,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportWithTargetName/1085af717993116c6838493c8bd8631f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 10:12:48,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:12:48,652 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689934342732.1085af717993116c6838493c8bd8631f. 2023-07-21 10:12:48,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 1085af717993116c6838493c8bd8631f: 2023-07-21 10:12:48,652 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=fa50a854452196fb1f8335e029f4b328, regionState=CLOSED 2023-07-21 10:12:48,653 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689934342732.fa50a854452196fb1f8335e029f4b328.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689934368652"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934368652"}]},"ts":"1689934368652"} 2023-07-21 10:12:48,655 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=1085af717993116c6838493c8bd8631f, regionState=CLOSED 2023-07-21 10:12:48,655 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689934342732.1085af717993116c6838493c8bd8631f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689934368655"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934368655"}]},"ts":"1689934368655"} 2023-07-21 10:12:48,657 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 1085af717993116c6838493c8bd8631f 2023-07-21 10:12:48,669 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-21 10:12:48,669 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure fa50a854452196fb1f8335e029f4b328, server=jenkins-hbase17.apache.org,36809,1689934328937 in 218 msec 2023-07-21 10:12:48,675 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-21 10:12:48,675 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure 1085af717993116c6838493c8bd8631f, server=jenkins-hbase17.apache.org,37151,1689934329015 in 217 msec 2023-07-21 10:12:48,677 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fa50a854452196fb1f8335e029f4b328, UNASSIGN in 234 msec 2023-07-21 10:12:48,679 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-21 10:12:48,679 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1085af717993116c6838493c8bd8631f, UNASSIGN in 240 msec 2023-07-21 10:12:48,681 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934368681"}]},"ts":"1689934368681"} 2023-07-21 10:12:48,685 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-21 10:12:48,850 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-21 10:12:48,857 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 841 msec 2023-07-21 10:12:49,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-21 10:12:49,140 INFO [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-21 10:12:49,145 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportWithTargetName 2023-07-21 10:12:49,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-21 10:12:49,154 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-21 10:12:49,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-21 10:12:49,156 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-21 10:12:49,159 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37151] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-21 10:12:49,163 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportWithTargetName/1085af717993116c6838493c8bd8631f 2023-07-21 10:12:49,163 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportWithTargetName/fa50a854452196fb1f8335e029f4b328 2023-07-21 10:12:49,170 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportWithTargetName/1085af717993116c6838493c8bd8631f/cf, FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportWithTargetName/1085af717993116c6838493c8bd8631f/recovered.edits] 2023-07-21 10:12:49,170 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportWithTargetName/fa50a854452196fb1f8335e029f4b328/cf, FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportWithTargetName/fa50a854452196fb1f8335e029f4b328/recovered.edits] 2023-07-21 10:12:49,178 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportWithTargetName/1085af717993116c6838493c8bd8631f/cf/6fdd2110592d4e049c5dc6832124aa51 to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/archive/data/default/testtb-testExportWithTargetName/1085af717993116c6838493c8bd8631f/cf/6fdd2110592d4e049c5dc6832124aa51 2023-07-21 10:12:49,178 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportWithTargetName/fa50a854452196fb1f8335e029f4b328/cf/f245b625c14c4334b588f618aa8a9606 to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/archive/data/default/testtb-testExportWithTargetName/fa50a854452196fb1f8335e029f4b328/cf/f245b625c14c4334b588f618aa8a9606 2023-07-21 10:12:49,181 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportWithTargetName/1085af717993116c6838493c8bd8631f/recovered.edits/9.seqid to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/archive/data/default/testtb-testExportWithTargetName/1085af717993116c6838493c8bd8631f/recovered.edits/9.seqid 2023-07-21 10:12:49,183 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportWithTargetName/fa50a854452196fb1f8335e029f4b328/recovered.edits/9.seqid to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/archive/data/default/testtb-testExportWithTargetName/fa50a854452196fb1f8335e029f4b328/recovered.edits/9.seqid 2023-07-21 10:12:49,185 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportWithTargetName/1085af717993116c6838493c8bd8631f 2023-07-21 10:12:49,185 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportWithTargetName/fa50a854452196fb1f8335e029f4b328 2023-07-21 10:12:49,185 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-21 10:12:49,186 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-21 10:12:49,187 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-21 10:12:49,191 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230721df503f77f84a46d09cb8fd72fa73d1bd to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230721df503f77f84a46d09cb8fd72fa73d1bd 2023-07-21 10:12:49,192 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230721a15f69f8f433430ab73a8e9bdd1a8d43 to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230721a15f69f8f433430ab73a8e9bdd1a8d43 2023-07-21 10:12:49,193 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-21 10:12:49,197 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-21 10:12:49,226 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-21 10:12:49,229 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-21 10:12:49,233 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-21 10:12:49,233 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-21 10:12:49,234 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689934342732.1085af717993116c6838493c8bd8631f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689934369233"}]},"ts":"9223372036854775807"} 2023-07-21 10:12:49,234 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689934342732.fa50a854452196fb1f8335e029f4b328.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689934369233"}]},"ts":"9223372036854775807"} 2023-07-21 10:12:49,246 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-21 10:12:49,246 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 1085af717993116c6838493c8bd8631f, NAME => 'testtb-testExportWithTargetName,,1689934342732.1085af717993116c6838493c8bd8631f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => fa50a854452196fb1f8335e029f4b328, NAME => 'testtb-testExportWithTargetName,1,1689934342732.fa50a854452196fb1f8335e029f4b328.', STARTKEY => '1', ENDKEY => ''}] 2023-07-21 10:12:49,246 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-21 10:12:49,247 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689934369247"}]},"ts":"9223372036854775807"} 2023-07-21 10:12:49,249 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-21 10:12:49,599 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-21 10:12:49,602 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-21 10:12:49,602 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-21 10:12:49,602 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-21 10:12:49,603 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-21 10:12:49,603 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-21 10:12:49,603 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-21 10:12:49,607 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 458 msec 2023-07-21 10:12:49,862 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:12:49,862 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-21 10:12:49,862 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:12:49,862 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-21 10:12:49,863 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-21 10:12:49,863 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:12:49,862 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-21 10:12:49,863 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-21 10:12:49,862 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:12:49,863 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-21 10:12:49,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-21 10:12:49,866 INFO [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-21 10:12:49,896 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-21 10:12:49,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:49,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportWithTargetName" 2023-07-21 10:12:49,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-21 10:12:49,955 INFO [Listener at jenkins-hbase17.apache.org/42227] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=748 (was 704) Potentially hanging thread: IPC Client (804182503) connection to jenkins-hbase17.apache.org/136.243.18.41:39407 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/cluster_d3b934de-fe44-3c44-e8a2-d5b9df6d6477/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/cluster_d3b934de-fe44-3c44-e8a2-d5b9df6d6477/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1bf23fcf-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1557406679_17 at /127.0.0.1:53506 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/cluster_d3b934de-fe44-3c44-e8a2-d5b9df6d6477/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1bf23fcf-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1bf23fcf-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/cluster_d3b934de-fe44-3c44-e8a2-d5b9df6d6477/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1557406679_17 at /127.0.0.1:51874 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/cluster_d3b934de-fe44-3c44-e8a2-d5b9df6d6477/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1557406679_17 at /127.0.0.1:45844 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1bf23fcf-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1318 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/cluster_d3b934de-fe44-3c44-e8a2-d5b9df6d6477/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=923 (was 903) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=785 (was 657) - SystemLoadAverage LEAK? -, ProcessCount=193 (was 187) - ProcessCount LEAK? -, AvailableMemoryMB=1534 (was 1469) - AvailableMemoryMB LEAK? - 2023-07-21 10:12:49,955 WARN [Listener at jenkins-hbase17.apache.org/42227] hbase.ResourceChecker(130): Thread=748 is superior to 500 2023-07-21 10:12:49,977 INFO [Listener at jenkins-hbase17.apache.org/42227] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=748, OpenFileDescriptor=923, MaxFileDescriptor=60000, SystemLoadAverage=785, ProcessCount=193, AvailableMemoryMB=1532 2023-07-21 10:12:49,978 WARN [Listener at jenkins-hbase17.apache.org/42227] hbase.ResourceChecker(130): Thread=748 is superior to 500 2023-07-21 10:12:49,980 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-21 10:12:49,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-21 10:12:49,985 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 10:12:49,986 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-21 10:12:49,987 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 10:12:49,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-21 10:12:49,990 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemState/9a880f17c6ac88e9a4632bac90fc8654 2023-07-21 10:12:49,990 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemState/4b0d5fefa91683edee659d073b6d14b6 2023-07-21 10:12:49,991 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemState/4b0d5fefa91683edee659d073b6d14b6 empty. 2023-07-21 10:12:49,991 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemState/9a880f17c6ac88e9a4632bac90fc8654 empty. 2023-07-21 10:12:49,991 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemState/4b0d5fefa91683edee659d073b6d14b6 2023-07-21 10:12:49,991 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemState/9a880f17c6ac88e9a4632bac90fc8654 2023-07-21 10:12:49,991 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-21 10:12:50,002 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-21 10:12:50,004 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9a880f17c6ac88e9a4632bac90fc8654, NAME => 'testtb-testExportFileSystemState,,1689934369979.9a880f17c6ac88e9a4632bac90fc8654.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp 2023-07-21 10:12:50,004 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4b0d5fefa91683edee659d073b6d14b6, NAME => 'testtb-testExportFileSystemState,1,1689934369979.4b0d5fefa91683edee659d073b6d14b6.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp 2023-07-21 10:12:50,022 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689934369979.9a880f17c6ac88e9a4632bac90fc8654.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:12:50,024 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 9a880f17c6ac88e9a4632bac90fc8654, disabling compactions & flushes 2023-07-21 10:12:50,024 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689934369979.9a880f17c6ac88e9a4632bac90fc8654. 2023-07-21 10:12:50,024 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689934369979.9a880f17c6ac88e9a4632bac90fc8654. 2023-07-21 10:12:50,024 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689934369979.9a880f17c6ac88e9a4632bac90fc8654. after waiting 0 ms 2023-07-21 10:12:50,024 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689934369979.9a880f17c6ac88e9a4632bac90fc8654. 2023-07-21 10:12:50,024 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689934369979.9a880f17c6ac88e9a4632bac90fc8654. 2023-07-21 10:12:50,024 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 9a880f17c6ac88e9a4632bac90fc8654: 2023-07-21 10:12:50,024 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689934369979.4b0d5fefa91683edee659d073b6d14b6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:12:50,034 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 4b0d5fefa91683edee659d073b6d14b6, disabling compactions & flushes 2023-07-21 10:12:50,034 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689934369979.4b0d5fefa91683edee659d073b6d14b6. 2023-07-21 10:12:50,034 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689934369979.4b0d5fefa91683edee659d073b6d14b6. 2023-07-21 10:12:50,034 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689934369979.4b0d5fefa91683edee659d073b6d14b6. after waiting 0 ms 2023-07-21 10:12:50,034 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689934369979.4b0d5fefa91683edee659d073b6d14b6. 2023-07-21 10:12:50,034 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689934369979.4b0d5fefa91683edee659d073b6d14b6. 2023-07-21 10:12:50,034 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 4b0d5fefa91683edee659d073b6d14b6: 2023-07-21 10:12:50,038 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 10:12:50,041 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689934369979.9a880f17c6ac88e9a4632bac90fc8654.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689934370040"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934370040"}]},"ts":"1689934370040"} 2023-07-21 10:12:50,041 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689934369979.4b0d5fefa91683edee659d073b6d14b6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689934370040"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934370040"}]},"ts":"1689934370040"} 2023-07-21 10:12:50,046 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-21 10:12:50,047 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 10:12:50,048 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934370048"}]},"ts":"1689934370048"} 2023-07-21 10:12:50,050 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-21 10:12:50,052 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-21 10:12:50,054 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 10:12:50,054 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 10:12:50,054 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 10:12:50,054 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 10:12:50,055 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9a880f17c6ac88e9a4632bac90fc8654, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4b0d5fefa91683edee659d073b6d14b6, ASSIGN}] 2023-07-21 10:12:50,058 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4b0d5fefa91683edee659d073b6d14b6, ASSIGN 2023-07-21 10:12:50,058 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9a880f17c6ac88e9a4632bac90fc8654, ASSIGN 2023-07-21 10:12:50,060 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4b0d5fefa91683edee659d073b6d14b6, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,37151,1689934329015; forceNewPlan=false, retain=false 2023-07-21 10:12:50,061 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9a880f17c6ac88e9a4632bac90fc8654, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,36809,1689934328937; forceNewPlan=false, retain=false 2023-07-21 10:12:50,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-21 10:12:50,210 INFO [jenkins-hbase17:35385] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-21 10:12:50,214 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=4b0d5fefa91683edee659d073b6d14b6, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:50,214 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=9a880f17c6ac88e9a4632bac90fc8654, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:50,214 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689934369979.4b0d5fefa91683edee659d073b6d14b6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689934370214"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934370214"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934370214"}]},"ts":"1689934370214"} 2023-07-21 10:12:50,214 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689934369979.9a880f17c6ac88e9a4632bac90fc8654.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689934370214"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934370214"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934370214"}]},"ts":"1689934370214"} 2023-07-21 10:12:50,217 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 4b0d5fefa91683edee659d073b6d14b6, server=jenkins-hbase17.apache.org,37151,1689934329015}] 2023-07-21 10:12:50,219 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 9a880f17c6ac88e9a4632bac90fc8654, server=jenkins-hbase17.apache.org,36809,1689934328937}] 2023-07-21 10:12:50,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-21 10:12:50,379 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689934369979.4b0d5fefa91683edee659d073b6d14b6. 2023-07-21 10:12:50,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4b0d5fefa91683edee659d073b6d14b6, NAME => 'testtb-testExportFileSystemState,1,1689934369979.4b0d5fefa91683edee659d073b6d14b6.', STARTKEY => '1', ENDKEY => ''} 2023-07-21 10:12:50,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689934369979.4b0d5fefa91683edee659d073b6d14b6. service=AccessControlService 2023-07-21 10:12:50,380 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:12:50,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 4b0d5fefa91683edee659d073b6d14b6 2023-07-21 10:12:50,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689934369979.4b0d5fefa91683edee659d073b6d14b6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:12:50,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 4b0d5fefa91683edee659d073b6d14b6 2023-07-21 10:12:50,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 4b0d5fefa91683edee659d073b6d14b6 2023-07-21 10:12:50,382 INFO [StoreOpener-4b0d5fefa91683edee659d073b6d14b6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4b0d5fefa91683edee659d073b6d14b6 2023-07-21 10:12:50,383 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689934369979.9a880f17c6ac88e9a4632bac90fc8654. 2023-07-21 10:12:50,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9a880f17c6ac88e9a4632bac90fc8654, NAME => 'testtb-testExportFileSystemState,,1689934369979.9a880f17c6ac88e9a4632bac90fc8654.', STARTKEY => '', ENDKEY => '1'} 2023-07-21 10:12:50,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689934369979.9a880f17c6ac88e9a4632bac90fc8654. service=AccessControlService 2023-07-21 10:12:50,384 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:12:50,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 9a880f17c6ac88e9a4632bac90fc8654 2023-07-21 10:12:50,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689934369979.9a880f17c6ac88e9a4632bac90fc8654.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:12:50,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 9a880f17c6ac88e9a4632bac90fc8654 2023-07-21 10:12:50,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 9a880f17c6ac88e9a4632bac90fc8654 2023-07-21 10:12:50,387 DEBUG [StoreOpener-4b0d5fefa91683edee659d073b6d14b6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemState/4b0d5fefa91683edee659d073b6d14b6/cf 2023-07-21 10:12:50,387 DEBUG [StoreOpener-4b0d5fefa91683edee659d073b6d14b6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemState/4b0d5fefa91683edee659d073b6d14b6/cf 2023-07-21 10:12:50,389 INFO [StoreOpener-4b0d5fefa91683edee659d073b6d14b6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4b0d5fefa91683edee659d073b6d14b6 columnFamilyName cf 2023-07-21 10:12:50,389 INFO [StoreOpener-9a880f17c6ac88e9a4632bac90fc8654-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9a880f17c6ac88e9a4632bac90fc8654 2023-07-21 10:12:50,392 DEBUG [StoreOpener-9a880f17c6ac88e9a4632bac90fc8654-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemState/9a880f17c6ac88e9a4632bac90fc8654/cf 2023-07-21 10:12:50,392 DEBUG [StoreOpener-9a880f17c6ac88e9a4632bac90fc8654-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemState/9a880f17c6ac88e9a4632bac90fc8654/cf 2023-07-21 10:12:50,392 INFO [StoreOpener-4b0d5fefa91683edee659d073b6d14b6-1] regionserver.HStore(310): Store=4b0d5fefa91683edee659d073b6d14b6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:12:50,394 INFO [StoreOpener-9a880f17c6ac88e9a4632bac90fc8654-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9a880f17c6ac88e9a4632bac90fc8654 columnFamilyName cf 2023-07-21 10:12:50,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemState/4b0d5fefa91683edee659d073b6d14b6 2023-07-21 10:12:50,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemState/4b0d5fefa91683edee659d073b6d14b6 2023-07-21 10:12:50,399 INFO [StoreOpener-9a880f17c6ac88e9a4632bac90fc8654-1] regionserver.HStore(310): Store=9a880f17c6ac88e9a4632bac90fc8654/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:12:50,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemState/9a880f17c6ac88e9a4632bac90fc8654 2023-07-21 10:12:50,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemState/9a880f17c6ac88e9a4632bac90fc8654 2023-07-21 10:12:50,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 4b0d5fefa91683edee659d073b6d14b6 2023-07-21 10:12:50,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 9a880f17c6ac88e9a4632bac90fc8654 2023-07-21 10:12:50,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemState/4b0d5fefa91683edee659d073b6d14b6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 10:12:50,412 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 4b0d5fefa91683edee659d073b6d14b6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67165744, jitterRate=8.475780487060547E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 10:12:50,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 4b0d5fefa91683edee659d073b6d14b6: 2023-07-21 10:12:50,417 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689934369979.4b0d5fefa91683edee659d073b6d14b6., pid=30, masterSystemTime=1689934370371 2023-07-21 10:12:50,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemState/9a880f17c6ac88e9a4632bac90fc8654/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 10:12:50,419 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 9a880f17c6ac88e9a4632bac90fc8654; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70031264, jitterRate=0.04354715347290039}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 10:12:50,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 9a880f17c6ac88e9a4632bac90fc8654: 2023-07-21 10:12:50,420 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689934369979.9a880f17c6ac88e9a4632bac90fc8654., pid=31, masterSystemTime=1689934370374 2023-07-21 10:12:50,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689934369979.4b0d5fefa91683edee659d073b6d14b6. 2023-07-21 10:12:50,421 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689934369979.4b0d5fefa91683edee659d073b6d14b6. 2023-07-21 10:12:50,422 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=4b0d5fefa91683edee659d073b6d14b6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:50,423 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689934369979.4b0d5fefa91683edee659d073b6d14b6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689934370422"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689934370422"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689934370422"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689934370422"}]},"ts":"1689934370422"} 2023-07-21 10:12:50,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689934369979.9a880f17c6ac88e9a4632bac90fc8654. 2023-07-21 10:12:50,423 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689934369979.9a880f17c6ac88e9a4632bac90fc8654. 2023-07-21 10:12:50,424 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=9a880f17c6ac88e9a4632bac90fc8654, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:50,426 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689934369979.9a880f17c6ac88e9a4632bac90fc8654.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689934370424"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689934370424"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689934370424"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689934370424"}]},"ts":"1689934370424"} 2023-07-21 10:12:50,435 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-21 10:12:50,435 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 4b0d5fefa91683edee659d073b6d14b6, server=jenkins-hbase17.apache.org,37151,1689934329015 in 210 msec 2023-07-21 10:12:50,436 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-21 10:12:50,438 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 9a880f17c6ac88e9a4632bac90fc8654, server=jenkins-hbase17.apache.org,36809,1689934328937 in 213 msec 2023-07-21 10:12:50,438 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4b0d5fefa91683edee659d073b6d14b6, ASSIGN in 380 msec 2023-07-21 10:12:50,441 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-21 10:12:50,441 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9a880f17c6ac88e9a4632bac90fc8654, ASSIGN in 382 msec 2023-07-21 10:12:50,442 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 10:12:50,442 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934370442"}]},"ts":"1689934370442"} 2023-07-21 10:12:50,445 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-21 10:12:50,448 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 10:12:50,449 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-21 10:12:50,452 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37151] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-21 10:12:50,453 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:12:50,453 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:12:50,453 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:12:50,453 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:12:50,455 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 10:12:50,455 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 10:12:50,456 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 10:12:50,456 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 10:12:50,456 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 10:12:50,457 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 10:12:50,459 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 475 msec 2023-07-21 10:12:50,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-21 10:12:50,592 INFO [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-21 10:12:50,596 DEBUG [Listener at jenkins-hbase17.apache.org/42227] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-21 10:12:50,596 DEBUG [Listener at jenkins-hbase17.apache.org/42227] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689934369979.9a880f17c6ac88e9a4632bac90fc8654. 2023-07-21 10:12:50,599 INFO [Listener at jenkins-hbase17.apache.org/42227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 10:12:50,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 10:12:50,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689934370639 (current time:1689934370639). 2023-07-21 10:12:50,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 10:12:50,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] zookeeper.ReadOnlyZKClient(139): Connect 0x2726d949 to 127.0.0.1:56971 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:12:50,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72139633, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:12:50,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:12:50,662 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:43876, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:12:50,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2726d949 to 127.0.0.1:56971 2023-07-21 10:12:50,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:12:50,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] zookeeper.ReadOnlyZKClient(139): Connect 0x67f5d1a0 to 127.0.0.1:56971 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:12:50,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7608a086, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:12:50,788 DEBUG [hconnection-0x18c4027a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:12:50,792 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:43880, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:12:50,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:12:50,800 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:53320, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:12:50,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x67f5d1a0 to 127.0.0.1:56971 2023-07-21 10:12:50,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:12:50,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-21 10:12:50,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 10:12:50,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 10:12:50,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-21 10:12:50,807 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-21 10:12:50,809 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689934970809 2023-07-21 10:12:50,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 10:12:50,810 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-21 10:12:50,810 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 10:12:50,811 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 10:12:50,814 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-21 10:12:50,816 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-21 10:12:50,819 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-07-21 10:12:50,823 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-21 10:12:50,825 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689934970825 2023-07-21 10:12:50,911 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:12:50,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 10:12:50,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:12:50,917 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 10:12:51,117 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:12:51,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 10:12:51,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:12:51,118 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 10:12:51,262 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,262 INFO [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-21 10:12:51,262 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:12:51,263 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-21 10:12:51,263 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-21 10:12:51,263 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,263 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,268 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:51,268 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:51,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:51,268 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:51,268 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:51,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:51,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:51,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:51,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:51,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:51,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,269 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:51,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,269 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:51,270 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,270 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,270 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-21 10:12:51,270 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:51,270 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 10:12:51,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,270 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-21 10:12:51,271 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,271 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-21 10:12:51,271 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:12:51,272 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-21 10:12:51,273 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-21 10:12:51,273 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,37151,1689934329015' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-21 10:12:51,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-21 10:12:51,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,273 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-21 10:12:51,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-21 10:12:51,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,274 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-21 10:12:51,274 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,274 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:51,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:51,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:12:51,274 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-21 10:12:51,274 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:12:51,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:12:51,275 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,275 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,275 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-21 10:12:51,275 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:12:51,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:12:51,278 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-21 10:12:51,279 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-21 10:12:51,279 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36809,1689934328937' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-21 10:12:51,277 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-21 10:12:51,275 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,279 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:12:51,279 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-21 10:12:51,279 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,38751,1689934329069' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-21 10:12:51,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:12:51,282 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,283 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:51,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:51,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:51,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:51,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:12:51,285 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,37151,1689934329015' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-21 10:12:51,285 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7dda4c7b[Count = 1] remaining members to acquire global barrier 2023-07-21 10:12:51,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:51,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:12:51,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:12:51,285 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,286 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,286 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:12:51,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:12:51,286 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,286 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:12:51,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:12:51,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:51,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:51,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:51,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:12:51,289 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,36809,1689934328937' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-21 10:12:51,289 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7dda4c7b[Count = 0] remaining members to acquire global barrier 2023-07-21 10:12:51,289 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-21 10:12:51,289 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,290 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,290 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,290 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,290 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-21 10:12:51,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,290 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-21 10:12:51,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,291 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-21 10:12:51,291 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-21 10:12:51,291 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,38751,1689934329069' in zk 2023-07-21 10:12:51,291 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:51,291 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:12:51,291 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:12:51,292 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-21 10:12:51,292 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:51,292 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:12:51,292 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 10:12:51,292 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-21 10:12:51,292 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:12:51,294 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689934369979.4b0d5fefa91683edee659d073b6d14b6. 2023-07-21 10:12:51,294 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:12:51,294 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689934369979.9a880f17c6ac88e9a4632bac90fc8654. 2023-07-21 10:12:51,294 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689934369979.4b0d5fefa91683edee659d073b6d14b6. started... 2023-07-21 10:12:51,294 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689934369979.9a880f17c6ac88e9a4632bac90fc8654. started... 2023-07-21 10:12:51,296 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9a880f17c6ac88e9a4632bac90fc8654: 2023-07-21 10:12:51,296 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4b0d5fefa91683edee659d073b6d14b6: 2023-07-21 10:12:51,296 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689934369979.9a880f17c6ac88e9a4632bac90fc8654.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,296 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689934369979.4b0d5fefa91683edee659d073b6d14b6.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,296 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:12:51,297 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:12:51,297 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 10:12:51,297 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 10:12:51,383 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689934369979.9a880f17c6ac88e9a4632bac90fc8654. completed. 2023-07-21 10:12:51,383 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689934369979.9a880f17c6ac88e9a4632bac90fc8654. 2023-07-21 10:12:51,383 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:12:51,383 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:12:51,384 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:51,384 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-21 10:12:51,384 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,36809,1689934328937' in zk 2023-07-21 10:12:51,385 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:51,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:51,385 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-21 10:12:51,385 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:12:51,386 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-21 10:12:51,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:12:51,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:12:51,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:12:51,388 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689934369979.4b0d5fefa91683edee659d073b6d14b6. completed. 2023-07-21 10:12:51,388 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689934369979.4b0d5fefa91683edee659d073b6d14b6. 2023-07-21 10:12:51,388 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:12:51,388 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:12:51,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:12:51,388 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:51,388 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-21 10:12:51,388 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,37151,1689934329015' in zk 2023-07-21 10:12:51,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,389 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-21 10:12:51,389 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:51,389 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:12:51,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:51,390 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-21 10:12:51,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:51,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:51,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:12:51,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:51,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:51,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:51,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase17.apache.org,36809,1689934328937': 2023-07-21 10:12:51,394 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,36809,1689934328937' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-21 10:12:51,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:51,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:12:51,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:12:51,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:12:51,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:12:51,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:51,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:51,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:51,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:12:51,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:51,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:51,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:51,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase17.apache.org,37151,1689934329015': 2023-07-21 10:12:51,398 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,37151,1689934329015' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-21 10:12:51,398 INFO [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-21 10:12:51,398 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 10:12:51,398 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 10:12:51,398 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,398 INFO [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 10:12:51,399 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,399 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:51,400 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,400 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,400 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,400 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:51,400 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:51,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:12:51,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:12:51,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:51,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:51,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:51,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:51,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:51,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:51,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:12:51,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,401 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:51,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,402 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:51,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:12:51,402 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:51,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:51,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:51,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:51,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:12:51,404 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:51,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,405 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:51,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:51,405 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:51,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:51,419 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:12:51,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 10:12:51,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:12:51,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:51,420 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-21 10:12:51,422 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:51,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:51,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:51,423 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:51,423 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,423 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:51,423 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:51,423 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,423 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:51,423 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,423 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:51,423 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:51,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:51,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:51,423 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:51,423 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:51,423 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,423 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-21 10:12:51,423 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:51,424 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,424 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,424 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-21 10:12:51,423 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:12:51,423 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:51,426 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:51,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:51,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:51,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:51,424 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:51,426 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-21 10:12:51,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:51,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:51,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:51,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:51,442 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,442 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,467 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,508 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-21 10:12:51,508 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,509 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:51,509 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689934370810Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689934371442 (+632 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689934371442Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689934371442Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689934371447 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689934371460 (+13 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689934371508 (+48 ms) 2023-07-21 10:12:51,511 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-21 10:12:51,536 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 700 msec 2023-07-21 10:12:51,921 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:12:51,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 10:12:51,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 10:12:51,928 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36809] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689934369979.9a880f17c6ac88e9a4632bac90fc8654. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 10:12:51,930 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37151] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689934369979.4b0d5fefa91683edee659d073b6d14b6. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 10:12:51,934 DEBUG [Listener at jenkins-hbase17.apache.org/42227] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-21 10:12:51,934 DEBUG [Listener at jenkins-hbase17.apache.org/42227] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689934369979.9a880f17c6ac88e9a4632bac90fc8654. 2023-07-21 10:12:51,935 INFO [Listener at jenkins-hbase17.apache.org/42227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 10:12:51,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 10:12:51,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689934371951 (current time:1689934371951). 2023-07-21 10:12:51,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 10:12:51,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] zookeeper.ReadOnlyZKClient(139): Connect 0x57b17db2 to 127.0.0.1:56971 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:12:51,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40bbb3ad, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:12:51,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:12:51,976 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:43888, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:12:51,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x57b17db2 to 127.0.0.1:56971 2023-07-21 10:12:51,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:12:51,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] zookeeper.ReadOnlyZKClient(139): Connect 0x0f77fd14 to 127.0.0.1:56971 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:12:51,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4eccbabd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:12:52,083 DEBUG [hconnection-0xe0d1924-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:12:52,084 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:43894, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:12:52,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:12:52,101 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:53336, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:12:52,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f77fd14 to 127.0.0.1:56971 2023-07-21 10:12:52,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:12:52,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-21 10:12:52,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 10:12:52,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 10:12:52,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-21 10:12:52,112 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-21 10:12:52,113 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689934972113 2023-07-21 10:12:52,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 10:12:52,114 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-21 10:12:52,117 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 10:12:52,117 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 10:12:52,119 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-21 10:12:52,121 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-21 10:12:52,122 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 12 msec 2023-07-21 10:12:52,125 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-21 10:12:52,127 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689934972127 2023-07-21 10:12:52,189 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-21 10:12:52,189 INFO [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-21 10:12:52,200 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:12:52,209 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-21 10:12:52,209 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-21 10:12:52,210 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,210 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,212 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:52,213 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:52,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:52,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:52,213 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:52,213 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:52,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,213 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:52,213 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 10:12:52,213 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-21 10:12:52,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,214 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-21 10:12:52,214 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-21 10:12:52,214 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-21 10:12:52,214 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:12:52,217 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:52,217 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:52,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:52,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:52,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:52,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:52,217 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-21 10:12:52,217 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-21 10:12:52,217 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,37151,1689934329015' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-21 10:12:52,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,220 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:12:52,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 10:12:52,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:12:52,223 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 10:12:52,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,232 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:52,232 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,232 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,233 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-21 10:12:52,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,234 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,234 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:12:52,234 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-21 10:12:52,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-21 10:12:52,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,235 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-21 10:12:52,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:52,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:12:52,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:12:52,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:12:52,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:12:52,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 10:12:52,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:52,239 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-21 10:12:52,239 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-21 10:12:52,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:12:52,240 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:12:52,240 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-21 10:12:52,241 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-21 10:12:52,241 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-21 10:12:52,242 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-21 10:12:52,242 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:12:52,242 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36809,1689934328937' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-21 10:12:52,243 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,37151,1689934329015' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-21 10:12:52,243 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b541381[Count = 1] remaining members to acquire global barrier 2023-07-21 10:12:52,243 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-21 10:12:52,243 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-21 10:12:52,244 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,38751,1689934329069' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-21 10:12:52,249 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:52,249 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:52,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:12:52,249 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:12:52,250 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,250 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,250 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934340509_0001_000001 (auth:SIMPLE) 2023-07-21 10:12:52,250 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:12:52,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:12:52,250 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:12:52,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:12:52,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 10:12:52,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:52,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:52,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:52,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:12:52,261 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,36809,1689934328937' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-21 10:12:52,261 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b541381[Count = 0] remaining members to acquire global barrier 2023-07-21 10:12:52,261 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-21 10:12:52,261 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,262 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,262 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,263 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-21 10:12:52,263 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-21 10:12:52,263 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:52,263 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-21 10:12:52,263 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,38751,1689934329069' in zk 2023-07-21 10:12:52,263 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:12:52,263 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:12:52,263 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689934369979.9a880f17c6ac88e9a4632bac90fc8654. 2023-07-21 10:12:52,263 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689934369979.9a880f17c6ac88e9a4632bac90fc8654. started... 2023-07-21 10:12:52,264 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,264 INFO [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9a880f17c6ac88e9a4632bac90fc8654 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-21 10:12:52,264 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-21 10:12:52,265 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:52,265 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 10:12:52,265 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:12:52,265 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:12:52,265 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689934369979.4b0d5fefa91683edee659d073b6d14b6. 2023-07-21 10:12:52,265 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689934369979.4b0d5fefa91683edee659d073b6d14b6. started... 2023-07-21 10:12:52,266 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-21 10:12:52,266 INFO [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4b0d5fefa91683edee659d073b6d14b6 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-21 10:12:52,266 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:12:52,266 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-21 10:12:52,322 INFO [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023072191a39dd18f574e1382bda49ef692f88a to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023072191a39dd18f574e1382bda49ef692f88a 2023-07-21 10:12:52,342 INFO [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023072184f0da04dc1549ea8c7c536a855e9d4e to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023072184f0da04dc1549ea8c7c536a855e9d4e 2023-07-21 10:12:52,346 INFO [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemState/9a880f17c6ac88e9a4632bac90fc8654/.tmp/cf/33e21f3dc01a4aaf9e150ff1e07d1c4f 2023-07-21 10:12:52,364 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemState/9a880f17c6ac88e9a4632bac90fc8654/.tmp/cf/33e21f3dc01a4aaf9e150ff1e07d1c4f as hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemState/9a880f17c6ac88e9a4632bac90fc8654/cf/33e21f3dc01a4aaf9e150ff1e07d1c4f 2023-07-21 10:12:52,375 INFO [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemState/9a880f17c6ac88e9a4632bac90fc8654/cf/33e21f3dc01a4aaf9e150ff1e07d1c4f, entries=4, sequenceid=6, filesize=5.6 K 2023-07-21 10:12:52,376 INFO [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 9a880f17c6ac88e9a4632bac90fc8654 in 112ms, sequenceid=6, compaction requested=false 2023-07-21 10:12:52,376 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-21 10:12:52,377 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9a880f17c6ac88e9a4632bac90fc8654: 2023-07-21 10:12:52,377 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689934369979.9a880f17c6ac88e9a4632bac90fc8654.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-21 10:12:52,377 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:12:52,377 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemState/9a880f17c6ac88e9a4632bac90fc8654/cf/33e21f3dc01a4aaf9e150ff1e07d1c4f] hfiles 2023-07-21 10:12:52,377 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemState/9a880f17c6ac88e9a4632bac90fc8654/cf/33e21f3dc01a4aaf9e150ff1e07d1c4f for snapshot=snaptb0-testExportFileSystemState 2023-07-21 10:12:52,424 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:12:52,426 INFO [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemState/4b0d5fefa91683edee659d073b6d14b6/.tmp/cf/e4a4ab67c24c4f5b8486a176a0cb0152 2023-07-21 10:12:52,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 10:12:52,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:12:52,427 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 10:12:52,447 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemState/4b0d5fefa91683edee659d073b6d14b6/.tmp/cf/e4a4ab67c24c4f5b8486a176a0cb0152 as hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemState/4b0d5fefa91683edee659d073b6d14b6/cf/e4a4ab67c24c4f5b8486a176a0cb0152 2023-07-21 10:12:52,448 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689934369979.9a880f17c6ac88e9a4632bac90fc8654. completed. 2023-07-21 10:12:52,449 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689934369979.9a880f17c6ac88e9a4632bac90fc8654. 2023-07-21 10:12:52,449 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:12:52,450 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:12:52,451 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:52,451 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-21 10:12:52,451 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,36809,1689934328937' in zk 2023-07-21 10:12:52,467 INFO [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemState/4b0d5fefa91683edee659d073b6d14b6/cf/e4a4ab67c24c4f5b8486a176a0cb0152, entries=46, sequenceid=6, filesize=12.7 K 2023-07-21 10:12:52,468 INFO [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 4b0d5fefa91683edee659d073b6d14b6 in 202ms, sequenceid=6, compaction requested=false 2023-07-21 10:12:52,468 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-21 10:12:52,468 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:12:52,468 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-21 10:12:52,470 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:52,470 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4b0d5fefa91683edee659d073b6d14b6: 2023-07-21 10:12:52,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:52,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:12:52,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:12:52,471 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689934369979.4b0d5fefa91683edee659d073b6d14b6.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-21 10:12:52,471 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:12:52,471 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemState/4b0d5fefa91683edee659d073b6d14b6/cf/e4a4ab67c24c4f5b8486a176a0cb0152] hfiles 2023-07-21 10:12:52,471 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemState/4b0d5fefa91683edee659d073b6d14b6/cf/e4a4ab67c24c4f5b8486a176a0cb0152 for snapshot=snaptb0-testExportFileSystemState 2023-07-21 10:12:52,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:12:52,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:12:52,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 10:12:52,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:52,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:52,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:52,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:12:52,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 10:12:52,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:52,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:52,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase17.apache.org,36809,1689934328937': 2023-07-21 10:12:52,483 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,36809,1689934328937' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-21 10:12:52,516 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689934369979.4b0d5fefa91683edee659d073b6d14b6. completed. 2023-07-21 10:12:52,516 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689934369979.4b0d5fefa91683edee659d073b6d14b6. 2023-07-21 10:12:52,516 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:12:52,516 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:12:52,517 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:52,517 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-21 10:12:52,517 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,37151,1689934329015' in zk 2023-07-21 10:12:52,518 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-21 10:12:52,518 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:12:52,518 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-21 10:12:52,524 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:52,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:52,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:12:52,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:12:52,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:12:52,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:12:52,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 10:12:52,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:52,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:52,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:52,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:12:52,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 10:12:52,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:52,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:52,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:52,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase17.apache.org,37151,1689934329015': 2023-07-21 10:12:52,531 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,37151,1689934329015' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-21 10:12:52,531 INFO [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-21 10:12:52,531 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 10:12:52,531 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 10:12:52,531 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-21 10:12:52,531 INFO [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 10:12:52,537 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,537 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:52,537 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,537 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:52,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:52,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:52,538 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:52,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:52,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:52,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,538 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:52,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,539 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:52,540 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:52,540 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:52,540 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,540 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,540 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:52,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,540 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:52,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:52,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:52,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:12:52,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:12:52,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:12:52,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 10:12:52,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:12:52,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 10:12:52,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:52,543 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:52,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:52,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:52,546 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:52,546 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:52,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:52,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:52,546 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:52,546 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:52,546 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:52,546 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,546 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:52,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:52,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:52,546 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:12:52,546 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-21 10:12:52,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:52,546 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:52,546 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-21 10:12:52,547 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-21 10:12:52,547 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:52,547 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,547 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:52,547 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:52,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:52,547 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-21 10:12:52,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:52,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:52,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:12:52,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:52,550 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023072184f0da04dc1549ea8c7c536a855e9d4e, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023072191a39dd18f574e1382bda49ef692f88a] mob files 2023-07-21 10:12:52,547 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:12:52,550 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023072184f0da04dc1549ea8c7c536a855e9d4e 2023-07-21 10:12:52,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:52,552 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023072191a39dd18f574e1382bda49ef692f88a 2023-07-21 10:12:52,550 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:12:52,553 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,553 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:12:52,562 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState because node does not exist (not an error) 2023-07-21 10:12:52,603 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-21 10:12:52,604 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,679 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,721 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-21 10:12:52,721 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,722 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,722 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689934372114Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689934372603 (+489 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689934372603Loading Region manifests for snaptb0-testExportFileSystemState at 1689934372603Writing data manifest for snaptb0-testExportFileSystemState at 1689934372613 (+10 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689934372652 (+39 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689934372721 (+69 ms) 2023-07-21 10:12:52,724 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-21 10:12:52,727 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 608 msec 2023-07-21 10:12:52,727 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:12:52,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 10:12:52,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 10:12:52,730 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934372730 2023-07-21 10:12:52,730 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost.localdomain:35937, tgtDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934372730, rawTgtDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934372730, srcFsUri=hdfs://localhost.localdomain:35937, srcDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f 2023-07-21 10:12:52,751 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:35937, inputRoot=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f 2023-07-21 10:12:52,751 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1088975574_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934372730, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934372730/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,751 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:35937, inputRoot=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f, snapshotDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-21 10:12:52,767 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934372730/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-21 10:12:52,807 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:52,808 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:52,808 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:52,808 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:52,809 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:52,809 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:52,809 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:52,885 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/hadoop-6230327834878181212.jar 2023-07-21 10:12:52,886 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:52,887 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:52,887 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:52,888 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:52,889 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:52,889 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:52,890 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-21 10:12:52,890 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-21 10:12:52,891 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-21 10:12:52,891 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-21 10:12:52,892 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-21 10:12:52,893 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-21 10:12:52,893 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-21 10:12:52,894 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-21 10:12:52,894 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-21 10:12:52,895 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-21 10:12:52,895 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:12:52,895 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:12:52,896 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 10:12:52,896 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:12:52,897 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:12:52,897 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 10:12:52,898 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 10:12:54,013 WARN [Listener at jenkins-hbase17.apache.org/42227] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-21 10:12:54,017 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-21 10:12:54,021 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-21 10:12:54,152 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 10:12:54,155 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 10:12:54,201 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934340509_0002_000001 (auth:SIMPLE) 2023-07-21 10:12:54,286 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 10:13:00,736 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934340509_0002_000001 (auth:SIMPLE) 2023-07-21 10:13:03,129 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934340509_0002_000001 (auth:SIMPLE) 2023-07-21 10:13:07,727 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934340509_0002_000001 (auth:SIMPLE) 2023-07-21 10:13:09,353 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-21 10:13:09,355 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-21 10:13:09,375 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-21 10:13:09,375 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-21 10:13:09,378 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-21 10:13:09,378 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1557406679_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-21 10:13:09,379 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-21 10:13:09,379 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-21 10:13:09,379 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1557406679_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934372730/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934372730/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-21 10:13:09,380 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934372730/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-21 10:13:09,380 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934372730/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-21 10:13:09,392 INFO [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-21 10:13:09,393 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportFileSystemState 2023-07-21 10:13:09,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-21 10:13:09,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-21 10:13:09,406 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934389406"}]},"ts":"1689934389406"} 2023-07-21 10:13:09,408 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-21 10:13:09,410 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-21 10:13:09,411 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9a880f17c6ac88e9a4632bac90fc8654, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4b0d5fefa91683edee659d073b6d14b6, UNASSIGN}] 2023-07-21 10:13:09,413 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9a880f17c6ac88e9a4632bac90fc8654, UNASSIGN 2023-07-21 10:13:09,415 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4b0d5fefa91683edee659d073b6d14b6, UNASSIGN 2023-07-21 10:13:09,417 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=4b0d5fefa91683edee659d073b6d14b6, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:13:09,417 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689934369979.4b0d5fefa91683edee659d073b6d14b6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689934389417"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934389417"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934389417"}]},"ts":"1689934389417"} 2023-07-21 10:13:09,418 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=9a880f17c6ac88e9a4632bac90fc8654, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:09,418 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689934369979.9a880f17c6ac88e9a4632bac90fc8654.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689934389418"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934389418"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934389418"}]},"ts":"1689934389418"} 2023-07-21 10:13:09,420 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 4b0d5fefa91683edee659d073b6d14b6, server=jenkins-hbase17.apache.org,37151,1689934329015}] 2023-07-21 10:13:09,422 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 9a880f17c6ac88e9a4632bac90fc8654, server=jenkins-hbase17.apache.org,36809,1689934328937}] 2023-07-21 10:13:09,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-21 10:13:09,576 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 4b0d5fefa91683edee659d073b6d14b6 2023-07-21 10:13:09,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 4b0d5fefa91683edee659d073b6d14b6, disabling compactions & flushes 2023-07-21 10:13:09,577 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689934369979.4b0d5fefa91683edee659d073b6d14b6. 2023-07-21 10:13:09,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689934369979.4b0d5fefa91683edee659d073b6d14b6. 2023-07-21 10:13:09,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689934369979.4b0d5fefa91683edee659d073b6d14b6. after waiting 0 ms 2023-07-21 10:13:09,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689934369979.4b0d5fefa91683edee659d073b6d14b6. 2023-07-21 10:13:09,583 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 9a880f17c6ac88e9a4632bac90fc8654 2023-07-21 10:13:09,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 9a880f17c6ac88e9a4632bac90fc8654, disabling compactions & flushes 2023-07-21 10:13:09,583 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689934369979.9a880f17c6ac88e9a4632bac90fc8654. 2023-07-21 10:13:09,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689934369979.9a880f17c6ac88e9a4632bac90fc8654. 2023-07-21 10:13:09,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689934369979.9a880f17c6ac88e9a4632bac90fc8654. after waiting 0 ms 2023-07-21 10:13:09,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689934369979.9a880f17c6ac88e9a4632bac90fc8654. 2023-07-21 10:13:09,601 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemState/4b0d5fefa91683edee659d073b6d14b6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 10:13:09,602 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:13:09,605 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689934369979.4b0d5fefa91683edee659d073b6d14b6. 2023-07-21 10:13:09,605 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 4b0d5fefa91683edee659d073b6d14b6: 2023-07-21 10:13:09,607 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemState/9a880f17c6ac88e9a4632bac90fc8654/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 10:13:09,607 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 4b0d5fefa91683edee659d073b6d14b6 2023-07-21 10:13:09,608 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:13:09,609 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689934369979.9a880f17c6ac88e9a4632bac90fc8654. 2023-07-21 10:13:09,609 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 9a880f17c6ac88e9a4632bac90fc8654: 2023-07-21 10:13:09,610 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=4b0d5fefa91683edee659d073b6d14b6, regionState=CLOSED 2023-07-21 10:13:09,610 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689934369979.4b0d5fefa91683edee659d073b6d14b6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689934389609"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934389609"}]},"ts":"1689934389609"} 2023-07-21 10:13:09,611 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 9a880f17c6ac88e9a4632bac90fc8654 2023-07-21 10:13:09,613 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=9a880f17c6ac88e9a4632bac90fc8654, regionState=CLOSED 2023-07-21 10:13:09,613 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689934369979.9a880f17c6ac88e9a4632bac90fc8654.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689934389612"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934389612"}]},"ts":"1689934389612"} 2023-07-21 10:13:09,617 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-21 10:13:09,617 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 4b0d5fefa91683edee659d073b6d14b6, server=jenkins-hbase17.apache.org,37151,1689934329015 in 191 msec 2023-07-21 10:13:09,619 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-21 10:13:09,619 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4b0d5fefa91683edee659d073b6d14b6, UNASSIGN in 206 msec 2023-07-21 10:13:09,619 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 9a880f17c6ac88e9a4632bac90fc8654, server=jenkins-hbase17.apache.org,36809,1689934328937 in 193 msec 2023-07-21 10:13:09,620 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-21 10:13:09,621 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9a880f17c6ac88e9a4632bac90fc8654, UNASSIGN in 208 msec 2023-07-21 10:13:09,621 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934389621"}]},"ts":"1689934389621"} 2023-07-21 10:13:09,623 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-21 10:13:09,624 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-21 10:13:09,626 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 230 msec 2023-07-21 10:13:09,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-21 10:13:09,704 INFO [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-21 10:13:09,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportFileSystemState 2023-07-21 10:13:09,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-21 10:13:09,707 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-21 10:13:09,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-21 10:13:09,708 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-21 10:13:09,710 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37151] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-21 10:13:09,712 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 10:13:09,712 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 10:13:09,712 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 10:13:09,712 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 10:13:09,712 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-21 10:13:09,713 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-21 10:13:09,713 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-21 10:13:09,713 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-21 10:13:09,714 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 10:13:09,714 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 10:13:09,714 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 10:13:09,714 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:13:09,714 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 10:13:09,714 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:13:09,714 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:13:09,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-21 10:13:09,716 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:13:09,716 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemState/9a880f17c6ac88e9a4632bac90fc8654 2023-07-21 10:13:09,720 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemState/4b0d5fefa91683edee659d073b6d14b6 2023-07-21 10:13:09,722 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemState/9a880f17c6ac88e9a4632bac90fc8654/cf, FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemState/9a880f17c6ac88e9a4632bac90fc8654/recovered.edits] 2023-07-21 10:13:09,723 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemState/4b0d5fefa91683edee659d073b6d14b6/cf, FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemState/4b0d5fefa91683edee659d073b6d14b6/recovered.edits] 2023-07-21 10:13:09,731 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemState/4b0d5fefa91683edee659d073b6d14b6/cf/e4a4ab67c24c4f5b8486a176a0cb0152 to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/archive/data/default/testtb-testExportFileSystemState/4b0d5fefa91683edee659d073b6d14b6/cf/e4a4ab67c24c4f5b8486a176a0cb0152 2023-07-21 10:13:09,732 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemState/9a880f17c6ac88e9a4632bac90fc8654/cf/33e21f3dc01a4aaf9e150ff1e07d1c4f to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/archive/data/default/testtb-testExportFileSystemState/9a880f17c6ac88e9a4632bac90fc8654/cf/33e21f3dc01a4aaf9e150ff1e07d1c4f 2023-07-21 10:13:09,736 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemState/9a880f17c6ac88e9a4632bac90fc8654/recovered.edits/9.seqid to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/archive/data/default/testtb-testExportFileSystemState/9a880f17c6ac88e9a4632bac90fc8654/recovered.edits/9.seqid 2023-07-21 10:13:09,736 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemState/4b0d5fefa91683edee659d073b6d14b6/recovered.edits/9.seqid to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/archive/data/default/testtb-testExportFileSystemState/4b0d5fefa91683edee659d073b6d14b6/recovered.edits/9.seqid 2023-07-21 10:13:09,740 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemState/9a880f17c6ac88e9a4632bac90fc8654 2023-07-21 10:13:09,742 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemState/4b0d5fefa91683edee659d073b6d14b6 2023-07-21 10:13:09,743 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-21 10:13:09,744 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-21 10:13:09,745 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-21 10:13:09,749 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023072184f0da04dc1549ea8c7c536a855e9d4e to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023072184f0da04dc1549ea8c7c536a855e9d4e 2023-07-21 10:13:09,750 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023072191a39dd18f574e1382bda49ef692f88a to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023072191a39dd18f574e1382bda49ef692f88a 2023-07-21 10:13:09,750 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-21 10:13:09,753 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-21 10:13:09,756 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-21 10:13:09,759 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-21 10:13:09,761 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-21 10:13:09,761 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-21 10:13:09,761 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689934369979.9a880f17c6ac88e9a4632bac90fc8654.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689934389761"}]},"ts":"9223372036854775807"} 2023-07-21 10:13:09,761 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689934369979.4b0d5fefa91683edee659d073b6d14b6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689934389761"}]},"ts":"9223372036854775807"} 2023-07-21 10:13:09,763 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-21 10:13:09,764 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9a880f17c6ac88e9a4632bac90fc8654, NAME => 'testtb-testExportFileSystemState,,1689934369979.9a880f17c6ac88e9a4632bac90fc8654.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 4b0d5fefa91683edee659d073b6d14b6, NAME => 'testtb-testExportFileSystemState,1,1689934369979.4b0d5fefa91683edee659d073b6d14b6.', STARTKEY => '1', ENDKEY => ''}] 2023-07-21 10:13:09,764 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-21 10:13:09,764 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689934389764"}]},"ts":"9223372036854775807"} 2023-07-21 10:13:09,766 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-21 10:13:09,767 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-21 10:13:09,769 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 64 msec 2023-07-21 10:13:09,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-21 10:13:09,819 INFO [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-21 10:13:09,830 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-21 10:13:09,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-21 10:13:09,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportFileSystemState" 2023-07-21 10:13:09,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-21 10:13:09,927 INFO [Listener at jenkins-hbase17.apache.org/42227] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=751 (was 748) Potentially hanging thread: hconnection-0x1bf23fcf-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1557406679_17 at /127.0.0.1:41120 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1bf23fcf-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1557406679_17 at /127.0.0.1:55700 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (804182503) connection to jenkins-hbase17.apache.org/136.243.18.41:41769 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1499317654_1 at /127.0.0.1:35296 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1557406679_17 at /127.0.0.1:49892 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1bf23fcf-shared-pool-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (804182503) connection to jenkins-hbase17.apache.org/136.243.18.41:43057 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1bf23fcf-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2027 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=923 (was 923), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=847 (was 785) - SystemLoadAverage LEAK? -, ProcessCount=193 (was 193), AvailableMemoryMB=1203 (was 1532) 2023-07-21 10:13:09,927 WARN [Listener at jenkins-hbase17.apache.org/42227] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-21 10:13:09,978 INFO [Listener at jenkins-hbase17.apache.org/42227] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=751, OpenFileDescriptor=923, MaxFileDescriptor=60000, SystemLoadAverage=847, ProcessCount=193, AvailableMemoryMB=1203 2023-07-21 10:13:09,978 WARN [Listener at jenkins-hbase17.apache.org/42227] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-21 10:13:09,981 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-21 10:13:09,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-21 10:13:09,994 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 10:13:09,997 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-21 10:13:09,998 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 10:13:10,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-21 10:13:10,004 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testConsecutiveExports/b40717d940e8fa490046ad11990fb125 2023-07-21 10:13:10,008 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testConsecutiveExports/b40717d940e8fa490046ad11990fb125 empty. 2023-07-21 10:13:10,008 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testConsecutiveExports/5a1dacc820fac98b67ec8c7a22cc4518 2023-07-21 10:13:10,014 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testConsecutiveExports/b40717d940e8fa490046ad11990fb125 2023-07-21 10:13:10,015 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testConsecutiveExports/5a1dacc820fac98b67ec8c7a22cc4518 empty. 2023-07-21 10:13:10,016 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testConsecutiveExports/5a1dacc820fac98b67ec8c7a22cc4518 2023-07-21 10:13:10,016 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-21 10:13:10,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-21 10:13:10,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-21 10:13:10,451 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-21 10:13:10,453 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 5a1dacc820fac98b67ec8c7a22cc4518, NAME => 'testtb-testConsecutiveExports,1,1689934389981.5a1dacc820fac98b67ec8c7a22cc4518.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp 2023-07-21 10:13:10,453 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => b40717d940e8fa490046ad11990fb125, NAME => 'testtb-testConsecutiveExports,,1689934389981.b40717d940e8fa490046ad11990fb125.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp 2023-07-21 10:13:10,482 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689934389981.b40717d940e8fa490046ad11990fb125.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:13:10,482 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing b40717d940e8fa490046ad11990fb125, disabling compactions & flushes 2023-07-21 10:13:10,482 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689934389981.b40717d940e8fa490046ad11990fb125. 2023-07-21 10:13:10,482 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689934389981.b40717d940e8fa490046ad11990fb125. 2023-07-21 10:13:10,482 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689934389981.b40717d940e8fa490046ad11990fb125. after waiting 0 ms 2023-07-21 10:13:10,482 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689934389981.b40717d940e8fa490046ad11990fb125. 2023-07-21 10:13:10,482 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689934389981.b40717d940e8fa490046ad11990fb125. 2023-07-21 10:13:10,483 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for b40717d940e8fa490046ad11990fb125: 2023-07-21 10:13:10,488 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689934389981.5a1dacc820fac98b67ec8c7a22cc4518.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:13:10,489 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 5a1dacc820fac98b67ec8c7a22cc4518, disabling compactions & flushes 2023-07-21 10:13:10,490 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689934389981.5a1dacc820fac98b67ec8c7a22cc4518. 2023-07-21 10:13:10,490 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689934389981.5a1dacc820fac98b67ec8c7a22cc4518. 2023-07-21 10:13:10,490 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689934389981.5a1dacc820fac98b67ec8c7a22cc4518. after waiting 0 ms 2023-07-21 10:13:10,490 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689934389981.5a1dacc820fac98b67ec8c7a22cc4518. 2023-07-21 10:13:10,490 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689934389981.5a1dacc820fac98b67ec8c7a22cc4518. 2023-07-21 10:13:10,490 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 5a1dacc820fac98b67ec8c7a22cc4518: 2023-07-21 10:13:10,492 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 10:13:10,506 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689934389981.b40717d940e8fa490046ad11990fb125.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689934390506"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934390506"}]},"ts":"1689934390506"} 2023-07-21 10:13:10,506 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689934389981.5a1dacc820fac98b67ec8c7a22cc4518.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689934390506"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934390506"}]},"ts":"1689934390506"} 2023-07-21 10:13:10,509 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-21 10:13:10,511 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 10:13:10,511 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934390511"}]},"ts":"1689934390511"} 2023-07-21 10:13:10,514 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-21 10:13:10,518 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-21 10:13:10,521 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 10:13:10,521 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 10:13:10,521 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 10:13:10,521 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 10:13:10,521 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b40717d940e8fa490046ad11990fb125, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5a1dacc820fac98b67ec8c7a22cc4518, ASSIGN}] 2023-07-21 10:13:10,524 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5a1dacc820fac98b67ec8c7a22cc4518, ASSIGN 2023-07-21 10:13:10,525 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b40717d940e8fa490046ad11990fb125, ASSIGN 2023-07-21 10:13:10,526 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b40717d940e8fa490046ad11990fb125, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,38751,1689934329069; forceNewPlan=false, retain=false 2023-07-21 10:13:10,526 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5a1dacc820fac98b67ec8c7a22cc4518, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,36809,1689934328937; forceNewPlan=false, retain=false 2023-07-21 10:13:10,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-21 10:13:10,676 INFO [jenkins-hbase17:35385] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-21 10:13:10,679 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=b40717d940e8fa490046ad11990fb125, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:13:10,679 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=5a1dacc820fac98b67ec8c7a22cc4518, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:10,679 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689934389981.b40717d940e8fa490046ad11990fb125.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689934390678"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934390678"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934390678"}]},"ts":"1689934390678"} 2023-07-21 10:13:10,679 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689934389981.5a1dacc820fac98b67ec8c7a22cc4518.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689934390678"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934390678"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934390678"}]},"ts":"1689934390678"} 2023-07-21 10:13:10,681 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure b40717d940e8fa490046ad11990fb125, server=jenkins-hbase17.apache.org,38751,1689934329069}] 2023-07-21 10:13:10,683 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 5a1dacc820fac98b67ec8c7a22cc4518, server=jenkins-hbase17.apache.org,36809,1689934328937}] 2023-07-21 10:13:10,842 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689934389981.5a1dacc820fac98b67ec8c7a22cc4518. 2023-07-21 10:13:10,843 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689934389981.b40717d940e8fa490046ad11990fb125. 2023-07-21 10:13:10,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5a1dacc820fac98b67ec8c7a22cc4518, NAME => 'testtb-testConsecutiveExports,1,1689934389981.5a1dacc820fac98b67ec8c7a22cc4518.', STARTKEY => '1', ENDKEY => ''} 2023-07-21 10:13:10,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b40717d940e8fa490046ad11990fb125, NAME => 'testtb-testConsecutiveExports,,1689934389981.b40717d940e8fa490046ad11990fb125.', STARTKEY => '', ENDKEY => '1'} 2023-07-21 10:13:10,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689934389981.5a1dacc820fac98b67ec8c7a22cc4518. service=AccessControlService 2023-07-21 10:13:10,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689934389981.b40717d940e8fa490046ad11990fb125. service=AccessControlService 2023-07-21 10:13:10,843 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:13:10,843 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:13:10,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 5a1dacc820fac98b67ec8c7a22cc4518 2023-07-21 10:13:10,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports b40717d940e8fa490046ad11990fb125 2023-07-21 10:13:10,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689934389981.5a1dacc820fac98b67ec8c7a22cc4518.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:13:10,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689934389981.b40717d940e8fa490046ad11990fb125.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:13:10,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 5a1dacc820fac98b67ec8c7a22cc4518 2023-07-21 10:13:10,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for b40717d940e8fa490046ad11990fb125 2023-07-21 10:13:10,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 5a1dacc820fac98b67ec8c7a22cc4518 2023-07-21 10:13:10,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for b40717d940e8fa490046ad11990fb125 2023-07-21 10:13:10,848 INFO [StoreOpener-5a1dacc820fac98b67ec8c7a22cc4518-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5a1dacc820fac98b67ec8c7a22cc4518 2023-07-21 10:13:10,853 DEBUG [StoreOpener-5a1dacc820fac98b67ec8c7a22cc4518-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testConsecutiveExports/5a1dacc820fac98b67ec8c7a22cc4518/cf 2023-07-21 10:13:10,853 DEBUG [StoreOpener-5a1dacc820fac98b67ec8c7a22cc4518-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testConsecutiveExports/5a1dacc820fac98b67ec8c7a22cc4518/cf 2023-07-21 10:13:10,854 INFO [StoreOpener-5a1dacc820fac98b67ec8c7a22cc4518-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5a1dacc820fac98b67ec8c7a22cc4518 columnFamilyName cf 2023-07-21 10:13:10,856 INFO [StoreOpener-5a1dacc820fac98b67ec8c7a22cc4518-1] regionserver.HStore(310): Store=5a1dacc820fac98b67ec8c7a22cc4518/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:13:10,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testConsecutiveExports/5a1dacc820fac98b67ec8c7a22cc4518 2023-07-21 10:13:10,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testConsecutiveExports/5a1dacc820fac98b67ec8c7a22cc4518 2023-07-21 10:13:10,865 INFO [StoreOpener-b40717d940e8fa490046ad11990fb125-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b40717d940e8fa490046ad11990fb125 2023-07-21 10:13:10,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 5a1dacc820fac98b67ec8c7a22cc4518 2023-07-21 10:13:10,867 DEBUG [StoreOpener-b40717d940e8fa490046ad11990fb125-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testConsecutiveExports/b40717d940e8fa490046ad11990fb125/cf 2023-07-21 10:13:10,867 DEBUG [StoreOpener-b40717d940e8fa490046ad11990fb125-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testConsecutiveExports/b40717d940e8fa490046ad11990fb125/cf 2023-07-21 10:13:10,868 INFO [StoreOpener-b40717d940e8fa490046ad11990fb125-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b40717d940e8fa490046ad11990fb125 columnFamilyName cf 2023-07-21 10:13:10,870 INFO [StoreOpener-b40717d940e8fa490046ad11990fb125-1] regionserver.HStore(310): Store=b40717d940e8fa490046ad11990fb125/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:13:10,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testConsecutiveExports/5a1dacc820fac98b67ec8c7a22cc4518/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 10:13:10,883 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 5a1dacc820fac98b67ec8c7a22cc4518; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69600854, jitterRate=0.03713354468345642}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 10:13:10,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testConsecutiveExports/b40717d940e8fa490046ad11990fb125 2023-07-21 10:13:10,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 5a1dacc820fac98b67ec8c7a22cc4518: 2023-07-21 10:13:10,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testConsecutiveExports/b40717d940e8fa490046ad11990fb125 2023-07-21 10:13:10,886 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689934389981.5a1dacc820fac98b67ec8c7a22cc4518., pid=46, masterSystemTime=1689934390835 2023-07-21 10:13:10,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689934389981.5a1dacc820fac98b67ec8c7a22cc4518. 2023-07-21 10:13:10,889 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689934389981.5a1dacc820fac98b67ec8c7a22cc4518. 2023-07-21 10:13:10,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for b40717d940e8fa490046ad11990fb125 2023-07-21 10:13:10,890 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=5a1dacc820fac98b67ec8c7a22cc4518, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:10,890 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689934389981.5a1dacc820fac98b67ec8c7a22cc4518.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689934390890"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689934390890"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689934390890"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689934390890"}]},"ts":"1689934390890"} 2023-07-21 10:13:10,897 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-21 10:13:10,898 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 5a1dacc820fac98b67ec8c7a22cc4518, server=jenkins-hbase17.apache.org,36809,1689934328937 in 210 msec 2023-07-21 10:13:10,903 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5a1dacc820fac98b67ec8c7a22cc4518, ASSIGN in 380 msec 2023-07-21 10:13:10,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testConsecutiveExports/b40717d940e8fa490046ad11990fb125/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 10:13:10,907 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened b40717d940e8fa490046ad11990fb125; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60019224, jitterRate=-0.1056438684463501}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 10:13:10,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for b40717d940e8fa490046ad11990fb125: 2023-07-21 10:13:10,908 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689934389981.b40717d940e8fa490046ad11990fb125., pid=45, masterSystemTime=1689934390834 2023-07-21 10:13:10,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689934389981.b40717d940e8fa490046ad11990fb125. 2023-07-21 10:13:10,910 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689934389981.b40717d940e8fa490046ad11990fb125. 2023-07-21 10:13:10,911 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=b40717d940e8fa490046ad11990fb125, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:13:10,911 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689934389981.b40717d940e8fa490046ad11990fb125.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689934390910"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689934390910"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689934390910"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689934390910"}]},"ts":"1689934390910"} 2023-07-21 10:13:10,916 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-21 10:13:10,916 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure b40717d940e8fa490046ad11990fb125, server=jenkins-hbase17.apache.org,38751,1689934329069 in 233 msec 2023-07-21 10:13:10,919 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-21 10:13:10,921 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b40717d940e8fa490046ad11990fb125, ASSIGN in 395 msec 2023-07-21 10:13:10,921 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 10:13:10,922 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934390921"}]},"ts":"1689934390921"} 2023-07-21 10:13:10,923 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-21 10:13:10,925 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 10:13:10,926 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-21 10:13:10,959 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37151] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-21 10:13:10,961 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:13:10,961 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:13:10,961 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:13:10,961 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:13:10,962 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-21 10:13:10,964 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-21 10:13:10,964 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-21 10:13:10,964 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-21 10:13:10,965 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 980 msec 2023-07-21 10:13:11,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-21 10:13:11,107 INFO [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-21 10:13:11,110 DEBUG [Listener at jenkins-hbase17.apache.org/42227] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-21 10:13:11,110 DEBUG [Listener at jenkins-hbase17.apache.org/42227] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689934389981.b40717d940e8fa490046ad11990fb125. 2023-07-21 10:13:11,114 INFO [Listener at jenkins-hbase17.apache.org/42227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 10:13:11,143 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-21 10:13:11,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689934391143 (current time:1689934391143). 2023-07-21 10:13:11,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 10:13:11,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] zookeeper.ReadOnlyZKClient(139): Connect 0x2e06f538 to 127.0.0.1:56971 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:13:11,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74ab082, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:13:11,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:13:11,154 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:45696, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:13:11,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2e06f538 to 127.0.0.1:56971 2023-07-21 10:13:11,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:13:11,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] zookeeper.ReadOnlyZKClient(139): Connect 0x569938bb to 127.0.0.1:56971 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:13:11,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4fafa865, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:13:11,190 DEBUG [hconnection-0x1d33dfb2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:13:11,199 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:45702, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:13:11,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:13:11,209 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:58840, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:13:11,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x569938bb to 127.0.0.1:56971 2023-07-21 10:13:11,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:13:11,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-21 10:13:11,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 10:13:11,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-21 10:13:11,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-21 10:13:11,217 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-21 10:13:11,218 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689934991218 2023-07-21 10:13:11,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-21 10:13:11,218 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-21 10:13:11,220 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 10:13:11,221 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 10:13:11,225 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-21 10:13:11,226 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-21 10:13:11,227 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 11 msec 2023-07-21 10:13:11,230 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-21 10:13:11,232 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689934991232 2023-07-21 10:13:11,247 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,248 INFO [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-21 10:13:11,248 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:13:11,249 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-21 10:13:11,249 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-21 10:13:11,252 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,252 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,253 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:13:11,253 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:13:11,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:13:11,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:13:11,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:13:11,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:13:11,253 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:11,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,253 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:11,254 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:13:11,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,254 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-21 10:13:11,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,255 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-21 10:13:11,256 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,256 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-21 10:13:11,256 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:13:11,256 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:13:11,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:13:11,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:13:11,256 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:13:11,258 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 10:13:11,258 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-21 10:13:11,256 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,260 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-21 10:13:11,260 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36809,1689934328937' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-21 10:13:11,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-21 10:13:11,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,262 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-21 10:13:11,262 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-21 10:13:11,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,262 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-21 10:13:11,262 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,262 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-21 10:13:11,262 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,263 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:13:11,263 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-21 10:13:11,263 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:13:11,264 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:11,264 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:11,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:13:11,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:13:11,264 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,264 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:13:11,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:13:11,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:13:11,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:11,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:13:11,265 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,36809,1689934328937' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-21 10:13:11,266 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@633cf9e0[Count = 1] remaining members to acquire global barrier 2023-07-21 10:13:11,273 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-21 10:13:11,273 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-21 10:13:11,273 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-21 10:13:11,273 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-21 10:13:11,273 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,38751,1689934329069' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-21 10:13:11,273 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,37151,1689934329015' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-21 10:13:11,277 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:13:11,277 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:13:11,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:13:11,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:13:11,278 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,278 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:13:11,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:13:11,278 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:13:11,278 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,278 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:13:11,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:13:11,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:13:11,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:11,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:13:11,280 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,38751,1689934329069' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-21 10:13:11,280 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@633cf9e0[Count = 0] remaining members to acquire global barrier 2023-07-21 10:13:11,280 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-21 10:13:11,280 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,285 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,286 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,286 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-21 10:13:11,286 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-21 10:13:11,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,286 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,37151,1689934329015' in zk 2023-07-21 10:13:11,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,286 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-21 10:13:11,286 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:11,287 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:13:11,287 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:13:11,287 DEBUG [rs(jenkins-hbase17.apache.org,38751,1689934329069)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689934389981.b40717d940e8fa490046ad11990fb125. 2023-07-21 10:13:11,287 DEBUG [rs(jenkins-hbase17.apache.org,38751,1689934329069)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689934389981.b40717d940e8fa490046ad11990fb125. started... 2023-07-21 10:13:11,287 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:13:11,287 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 10:13:11,287 DEBUG [rs(jenkins-hbase17.apache.org,38751,1689934329069)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b40717d940e8fa490046ad11990fb125: 2023-07-21 10:13:11,287 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-21 10:13:11,287 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:13:11,287 DEBUG [rs(jenkins-hbase17.apache.org,38751,1689934329069)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689934389981.b40717d940e8fa490046ad11990fb125.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,287 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-21 10:13:11,287 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,288 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-21 10:13:11,288 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:13:11,288 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:13:11,288 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689934389981.5a1dacc820fac98b67ec8c7a22cc4518. 2023-07-21 10:13:11,288 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689934389981.5a1dacc820fac98b67ec8c7a22cc4518. started... 2023-07-21 10:13:11,290 DEBUG [rs(jenkins-hbase17.apache.org,38751,1689934329069)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:13:11,290 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5a1dacc820fac98b67ec8c7a22cc4518: 2023-07-21 10:13:11,290 DEBUG [rs(jenkins-hbase17.apache.org,38751,1689934329069)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 10:13:11,290 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689934389981.5a1dacc820fac98b67ec8c7a22cc4518.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,290 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:13:11,290 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 10:13:11,300 DEBUG [rs(jenkins-hbase17.apache.org,38751,1689934329069)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689934389981.b40717d940e8fa490046ad11990fb125. completed. 2023-07-21 10:13:11,300 DEBUG [rs(jenkins-hbase17.apache.org,38751,1689934329069)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689934389981.b40717d940e8fa490046ad11990fb125. 2023-07-21 10:13:11,300 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:13:11,300 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:13:11,301 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:13:11,301 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-21 10:13:11,301 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,38751,1689934329069' in zk 2023-07-21 10:13:11,302 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-21 10:13:11,302 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:13:11,302 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-21 10:13:11,309 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:13:11,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:13:11,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:13:11,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:13:11,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:13:11,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:13:11,315 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689934389981.5a1dacc820fac98b67ec8c7a22cc4518. completed. 2023-07-21 10:13:11,315 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689934389981.5a1dacc820fac98b67ec8c7a22cc4518. 2023-07-21 10:13:11,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,315 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:13:11,315 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:13:11,315 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:11,315 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-21 10:13:11,315 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,36809,1689934328937' in zk 2023-07-21 10:13:11,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:13:11,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:13:11,316 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:11,318 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-21 10:13:11,318 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:13:11,319 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-21 10:13:11,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:11,321 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:13:11,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:13:11,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:13:11,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-21 10:13:11,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:13:11,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:13:11,322 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 10:13:11,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:11,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase17.apache.org,38751,1689934329069': 2023-07-21 10:13:11,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,38751,1689934329069' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-21 10:13:11,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:11,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:13:11,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:13:11,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:13:11,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:13:11,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:13:11,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:13:11,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:11,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:13:11,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:13:11,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:13:11,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:11,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase17.apache.org,36809,1689934328937': 2023-07-21 10:13:11,330 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,36809,1689934328937' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-21 10:13:11,330 INFO [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-21 10:13:11,330 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 10:13:11,330 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 10:13:11,330 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,330 INFO [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 10:13:11,332 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,332 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,332 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:13:11,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:13:11,332 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:13:11,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,332 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:13:11,332 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:13:11,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,332 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:13:11,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:13:11,333 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:13:11,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:13:11,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:13:11,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:13:11,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:13:11,333 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:13:11,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:13:11,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:13:11,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,334 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:11,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:13:11,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:13:11,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:11,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:13:11,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,336 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:13:11,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:13:11,336 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:13:11,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:13:11,337 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:11,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:11,339 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:11,339 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,339 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:13:11,339 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:13:11,339 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,339 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:13:11,339 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:11,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:13:11,339 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:13:11,339 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:13:11,340 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:13:11,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:13:11,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:13:11,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:13:11,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:13:11,339 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:13:11,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:13:11,339 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,342 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:13:11,342 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:13:11,342 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,342 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,339 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:13:11,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:13:11,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:13:11,340 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,342 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-21 10:13:11,340 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:13:11,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:13:11,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:13:11,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:13:11,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:13:11,342 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,343 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-21 10:13:11,343 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-21 10:13:11,362 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,363 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,399 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,428 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-21 10:13:11,428 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,429 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:11,429 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689934391218Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689934391362 (+144 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689934391362Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689934391362Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689934391366 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689934391389 (+23 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689934391428 (+39 ms) 2023-07-21 10:13:11,431 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-21 10:13:11,432 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 211 msec 2023-07-21 10:13:11,522 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:13:11,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-21 10:13:11,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 10:13:11,527 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38751] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689934389981.b40717d940e8fa490046ad11990fb125. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 10:13:11,528 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36809] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689934389981.5a1dacc820fac98b67ec8c7a22cc4518. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 10:13:11,531 DEBUG [Listener at jenkins-hbase17.apache.org/42227] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-21 10:13:11,531 DEBUG [Listener at jenkins-hbase17.apache.org/42227] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689934389981.b40717d940e8fa490046ad11990fb125. 2023-07-21 10:13:11,532 INFO [Listener at jenkins-hbase17.apache.org/42227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 10:13:11,544 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-21 10:13:11,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689934391544 (current time:1689934391544). 2023-07-21 10:13:11,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 10:13:11,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] zookeeper.ReadOnlyZKClient(139): Connect 0x0b037de5 to 127.0.0.1:56971 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:13:11,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61aaf554, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:13:11,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:13:11,561 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:45704, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:13:11,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b037de5 to 127.0.0.1:56971 2023-07-21 10:13:11,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:13:11,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] zookeeper.ReadOnlyZKClient(139): Connect 0x0e67bf35 to 127.0.0.1:56971 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:13:11,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e1b1749, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:13:11,580 DEBUG [hconnection-0x28ad418b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:13:11,584 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:45718, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:13:11,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:13:11,591 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:58856, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:13:11,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e67bf35 to 127.0.0.1:56971 2023-07-21 10:13:11,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:13:11,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-21 10:13:11,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 10:13:11,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-21 10:13:11,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-21 10:13:11,598 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-21 10:13:11,599 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689934991598 2023-07-21 10:13:11,599 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-21 10:13:11,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-21 10:13:11,600 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 10:13:11,600 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 10:13:11,601 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-21 10:13:11,601 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-21 10:13:11,602 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-21 10:13:11,603 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-21 10:13:11,604 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689934991604 2023-07-21 10:13:11,612 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-21 10:13:11,612 INFO [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-21 10:13:11,612 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:13:11,613 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-21 10:13:11,614 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-21 10:13:11,614 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,614 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,615 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:13:11,615 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:13:11,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:13:11,615 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:13:11,615 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:11,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:13:11,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:13:11,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:13:11,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:13:11,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:13:11,615 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:11,615 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:13:11,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,616 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:13:11,616 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,616 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,616 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 10:13:11,616 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-21 10:13:11,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-21 10:13:11,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,617 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-21 10:13:11,617 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-21 10:13:11,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-21 10:13:11,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,617 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-21 10:13:11,617 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-21 10:13:11,617 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-21 10:13:11,618 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-21 10:13:11,618 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-21 10:13:11,618 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:13:11,617 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-21 10:13:11,618 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:13:11,619 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-21 10:13:11,619 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-21 10:13:11,619 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-21 10:13:11,620 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36809,1689934328937' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-21 10:13:11,619 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-21 10:13:11,619 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-21 10:13:11,620 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:13:11,620 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,38751,1689934329069' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-21 10:13:11,620 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-21 10:13:11,620 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-21 10:13:11,620 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,37151,1689934329015' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-21 10:13:11,625 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,625 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,626 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,626 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,626 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:13:11,626 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:11,626 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:11,626 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,626 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:13:11,626 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:13:11,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:13:11,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:13:11,626 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:13:11,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:13:11,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:13:11,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 10:13:11,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:13:11,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:13:11,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:11,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:13:11,628 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,36809,1689934328937' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-21 10:13:11,628 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@740c7daa[Count = 1] remaining members to acquire global barrier 2023-07-21 10:13:11,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:13:11,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:13:11,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:13:11,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:13:11,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:13:11,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 10:13:11,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:13:11,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:13:11,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:11,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:13:11,630 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,38751,1689934329069' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-21 10:13:11,630 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@740c7daa[Count = 0] remaining members to acquire global barrier 2023-07-21 10:13:11,630 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-21 10:13:11,630 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,630 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,630 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,631 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:11,630 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,631 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-21 10:13:11,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,631 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-21 10:13:11,631 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-21 10:13:11,631 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-21 10:13:11,631 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:13:11,631 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:13:11,631 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:13:11,631 DEBUG [rs(jenkins-hbase17.apache.org,38751,1689934329069)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689934389981.b40717d940e8fa490046ad11990fb125. 2023-07-21 10:13:11,631 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 10:13:11,631 DEBUG [rs(jenkins-hbase17.apache.org,38751,1689934329069)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689934389981.b40717d940e8fa490046ad11990fb125. started... 2023-07-21 10:13:11,631 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,37151,1689934329015' in zk 2023-07-21 10:13:11,631 INFO [rs(jenkins-hbase17.apache.org,38751,1689934329069)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b40717d940e8fa490046ad11990fb125 1/1 column families, dataSize=65 B heapSize=400 B 2023-07-21 10:13:11,632 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-21 10:13:11,632 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:13:11,632 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:13:11,632 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-21 10:13:11,633 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:13:11,632 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689934389981.5a1dacc820fac98b67ec8c7a22cc4518. 2023-07-21 10:13:11,634 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689934389981.5a1dacc820fac98b67ec8c7a22cc4518. started... 2023-07-21 10:13:11,634 INFO [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5a1dacc820fac98b67ec8c7a22cc4518 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-07-21 10:13:11,659 INFO [rs(jenkins-hbase17.apache.org,38751,1689934329069)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307217f5fc18da05445a989067b648b9f5242 to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307217f5fc18da05445a989067b648b9f5242 2023-07-21 10:13:11,663 INFO [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230721c67a82bf8c8d46ff8f6403cc9ce4e3bd to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230721c67a82bf8c8d46ff8f6403cc9ce4e3bd 2023-07-21 10:13:11,670 INFO [rs(jenkins-hbase17.apache.org,38751,1689934329069)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=65, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testConsecutiveExports/b40717d940e8fa490046ad11990fb125/.tmp/cf/e3acaf4e30e3451a885b461f8e9c52e8 2023-07-21 10:13:11,678 INFO [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.2 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testConsecutiveExports/5a1dacc820fac98b67ec8c7a22cc4518/.tmp/cf/8d783574d3e442e595934d5c8a8c0013 2023-07-21 10:13:11,680 DEBUG [rs(jenkins-hbase17.apache.org,38751,1689934329069)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testConsecutiveExports/b40717d940e8fa490046ad11990fb125/.tmp/cf/e3acaf4e30e3451a885b461f8e9c52e8 as hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testConsecutiveExports/b40717d940e8fa490046ad11990fb125/cf/e3acaf4e30e3451a885b461f8e9c52e8 2023-07-21 10:13:11,686 INFO [rs(jenkins-hbase17.apache.org,38751,1689934329069)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testConsecutiveExports/b40717d940e8fa490046ad11990fb125/cf/e3acaf4e30e3451a885b461f8e9c52e8, entries=1, sequenceid=6, filesize=5.1 K 2023-07-21 10:13:11,687 INFO [rs(jenkins-hbase17.apache.org,38751,1689934329069)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for b40717d940e8fa490046ad11990fb125 in 56ms, sequenceid=6, compaction requested=false 2023-07-21 10:13:11,687 DEBUG [rs(jenkins-hbase17.apache.org,38751,1689934329069)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-21 10:13:11,687 DEBUG [rs(jenkins-hbase17.apache.org,38751,1689934329069)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b40717d940e8fa490046ad11990fb125: 2023-07-21 10:13:11,688 DEBUG [rs(jenkins-hbase17.apache.org,38751,1689934329069)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689934389981.b40717d940e8fa490046ad11990fb125.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-21 10:13:11,688 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testConsecutiveExports/5a1dacc820fac98b67ec8c7a22cc4518/.tmp/cf/8d783574d3e442e595934d5c8a8c0013 as hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testConsecutiveExports/5a1dacc820fac98b67ec8c7a22cc4518/cf/8d783574d3e442e595934d5c8a8c0013 2023-07-21 10:13:11,690 DEBUG [rs(jenkins-hbase17.apache.org,38751,1689934329069)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:13:11,690 DEBUG [rs(jenkins-hbase17.apache.org,38751,1689934329069)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testConsecutiveExports/b40717d940e8fa490046ad11990fb125/cf/e3acaf4e30e3451a885b461f8e9c52e8] hfiles 2023-07-21 10:13:11,690 DEBUG [rs(jenkins-hbase17.apache.org,38751,1689934329069)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testConsecutiveExports/b40717d940e8fa490046ad11990fb125/cf/e3acaf4e30e3451a885b461f8e9c52e8 for snapshot=snaptb0-testConsecutiveExports 2023-07-21 10:13:11,700 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:13:11,701 INFO [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testConsecutiveExports/5a1dacc820fac98b67ec8c7a22cc4518/cf/8d783574d3e442e595934d5c8a8c0013, entries=49, sequenceid=6, filesize=13.0 K 2023-07-21 10:13:11,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-21 10:13:11,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:13:11,713 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 10:13:11,717 INFO [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for 5a1dacc820fac98b67ec8c7a22cc4518 in 83ms, sequenceid=6, compaction requested=false 2023-07-21 10:13:11,719 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5a1dacc820fac98b67ec8c7a22cc4518: 2023-07-21 10:13:11,719 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689934389981.5a1dacc820fac98b67ec8c7a22cc4518.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-21 10:13:11,719 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:13:11,719 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testConsecutiveExports/5a1dacc820fac98b67ec8c7a22cc4518/cf/8d783574d3e442e595934d5c8a8c0013] hfiles 2023-07-21 10:13:11,719 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testConsecutiveExports/5a1dacc820fac98b67ec8c7a22cc4518/cf/8d783574d3e442e595934d5c8a8c0013 for snapshot=snaptb0-testConsecutiveExports 2023-07-21 10:13:11,743 DEBUG [rs(jenkins-hbase17.apache.org,38751,1689934329069)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689934389981.b40717d940e8fa490046ad11990fb125. completed. 2023-07-21 10:13:11,744 DEBUG [rs(jenkins-hbase17.apache.org,38751,1689934329069)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689934389981.b40717d940e8fa490046ad11990fb125. 2023-07-21 10:13:11,744 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:13:11,744 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:13:11,744 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:13:11,746 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-21 10:13:11,746 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,38751,1689934329069' in zk 2023-07-21 10:13:11,749 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:13:11,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:13:11,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:13:11,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:13:11,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:13:11,750 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-21 10:13:11,750 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:13:11,750 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-21 10:13:11,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:13:11,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 10:13:11,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:13:11,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:13:11,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:11,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:13:11,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 10:13:11,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:13:11,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:13:11,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase17.apache.org,38751,1689934329069': 2023-07-21 10:13:11,754 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,38751,1689934329069' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-21 10:13:11,776 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689934389981.5a1dacc820fac98b67ec8c7a22cc4518. completed. 2023-07-21 10:13:11,776 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689934389981.5a1dacc820fac98b67ec8c7a22cc4518. 2023-07-21 10:13:11,776 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:13:11,776 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:13:11,776 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:11,776 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-21 10:13:11,776 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,36809,1689934328937' in zk 2023-07-21 10:13:11,785 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:11,785 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-21 10:13:11,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:11,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:13:11,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:13:11,785 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:13:11,786 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-21 10:13:11,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:13:11,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:13:11,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 10:13:11,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:13:11,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:13:11,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:11,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:13:11,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 10:13:11,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:13:11,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:13:11,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:11,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase17.apache.org,36809,1689934328937': 2023-07-21 10:13:11,790 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,36809,1689934328937' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-21 10:13:11,790 INFO [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-21 10:13:11,790 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 10:13:11,790 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 10:13:11,790 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-21 10:13:11,790 INFO [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 10:13:11,791 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,791 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,791 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,791 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:13:11,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:13:11,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:13:11,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,791 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:13:11,791 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:13:11,792 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:13:11,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,792 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:13:11,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 10:13:11,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:13:11,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:13:11,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:13:11,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:13:11,793 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:13:11,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:13:11,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:13:11,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:13:11,793 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:11,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 10:13:11,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:13:11,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:13:11,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:11,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:13:11,795 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:13:11,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 10:13:11,795 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:13:11,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:13:11,795 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:11,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:13:11,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:11,799 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:13:11,799 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:11,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:13:11,799 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,799 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:13:11,800 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:13:11,800 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:13:11,800 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:13:11,800 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:13:11,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:13:11,801 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:13:11,801 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:13:11,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:13:11,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:13:11,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:13:11,800 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:13:11,800 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-21 10:13:11,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:13:11,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:13:11,801 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:13:11,801 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-21 10:13:11,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:13:11,801 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:11,802 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-21 10:13:11,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:13:11,802 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:13:11,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:13:11,802 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:13:11,802 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-21 10:13:11,802 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:13:11,802 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,802 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,803 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230721c67a82bf8c8d46ff8f6403cc9ce4e3bd, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307217f5fc18da05445a989067b648b9f5242] mob files 2023-07-21 10:13:11,803 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230721c67a82bf8c8d46ff8f6403cc9ce4e3bd 2023-07-21 10:13:11,803 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307217f5fc18da05445a989067b648b9f5242 2023-07-21 10:13:11,810 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-21 10:13:11,810 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,827 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,846 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-21 10:13:11,846 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,847 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,847 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689934391599Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689934391810 (+211 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689934391810Loading Region manifests for snaptb0-testConsecutiveExports at 1689934391810Writing data manifest for snaptb0-testConsecutiveExports at 1689934391814 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689934391821 (+7 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689934391846 (+25 ms) 2023-07-21 10:13:11,850 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-21 10:13:11,852 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 250 msec 2023-07-21 10:13:11,913 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:13:11,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-21 10:13:11,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 10:13:11,915 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/local-export-1689934391915 2023-07-21 10:13:11,915 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/local-export-1689934391915, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/local-export-1689934391915, srcFsUri=hdfs://localhost.localdomain:35937, srcDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f 2023-07-21 10:13:11,933 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:35937, inputRoot=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f 2023-07-21 10:13:11,933 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@6e0b32c2, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/local-export-1689934391915, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/local-export-1689934391915/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,933 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:35937, inputRoot=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f, snapshotDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-21 10:13:11,942 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/local-export-1689934391915/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-21 10:13:11,956 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:11,957 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:11,957 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:11,958 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:11,958 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:11,958 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:11,959 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:12,020 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/hadoop-1474996128779688927.jar 2023-07-21 10:13:12,021 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:12,021 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:12,021 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:12,022 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:12,022 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:12,022 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:12,023 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-21 10:13:12,023 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-21 10:13:12,023 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-21 10:13:12,024 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-21 10:13:12,024 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-21 10:13:12,024 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-21 10:13:12,025 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-21 10:13:12,025 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-21 10:13:12,025 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-21 10:13:12,025 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-21 10:13:12,026 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:13:12,026 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:13:12,026 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 10:13:12,027 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:13:12,027 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:13:12,027 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 10:13:12,028 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 10:13:12,918 WARN [Listener at jenkins-hbase17.apache.org/42227] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-21 10:13:12,921 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-21 10:13:12,923 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-21 10:13:13,921 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 10:13:13,921 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 10:13:13,926 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934340509_0002_000001 (auth:SIMPLE) 2023-07-21 10:13:14,269 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934340509_0003_000001 (auth:SIMPLE) 2023-07-21 10:13:15,223 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 10:13:20,224 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934340509_0003_000001 (auth:SIMPLE) 2023-07-21 10:13:22,555 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934340509_0003_000001 (auth:SIMPLE) 2023-07-21 10:13:26,959 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934340509_0003_000001 (auth:SIMPLE) 2023-07-21 10:13:28,190 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-21 10:13:28,191 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-21 10:13:28,228 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-21 10:13:28,228 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-21 10:13:28,229 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-21 10:13:28,229 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1557406679_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-21 10:13:28,241 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-21 10:13:28,241 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-21 10:13:28,241 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@2aad26ca in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/local-export-1689934391915/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/local-export-1689934391915/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-21 10:13:28,242 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/local-export-1689934391915/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-21 10:13:28,242 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/local-export-1689934391915/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-21 10:13:28,252 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/local-export-1689934391915, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/local-export-1689934391915, srcFsUri=hdfs://localhost.localdomain:35937, srcDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f 2023-07-21 10:13:28,301 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:35937, inputRoot=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f 2023-07-21 10:13:28,302 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@361dde31, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/local-export-1689934391915, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/local-export-1689934391915/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-21 10:13:28,302 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:35937, inputRoot=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f, snapshotDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-21 10:13:28,367 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/local-export-1689934391915/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-21 10:13:28,392 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:28,393 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:28,394 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:28,394 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:28,395 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:28,395 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:28,396 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:28,486 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/hadoop-1526930110899766083.jar 2023-07-21 10:13:28,486 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:28,487 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:28,487 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:28,488 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:28,489 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:28,489 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:28,490 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-21 10:13:28,490 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-21 10:13:28,491 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-21 10:13:28,491 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-21 10:13:28,492 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-21 10:13:28,493 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-21 10:13:28,493 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-21 10:13:28,493 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-21 10:13:28,494 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-21 10:13:28,495 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-21 10:13:28,495 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:13:28,496 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:13:28,496 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 10:13:28,497 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:13:28,497 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:13:28,498 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 10:13:28,498 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 10:13:30,035 WARN [Listener at jenkins-hbase17.apache.org/42227] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-21 10:13:30,037 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-21 10:13:30,040 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-21 10:13:33,270 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 10:13:33,270 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 10:13:33,285 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934340509_0003_000001 (auth:SIMPLE) 2023-07-21 10:13:33,949 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934340509_0004_000001 (auth:SIMPLE) 2023-07-21 10:13:45,559 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934340509_0004_000001 (auth:SIMPLE) 2023-07-21 10:13:48,057 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934340509_0004_000001 (auth:SIMPLE) 2023-07-21 10:13:57,677 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-21 10:13:57,678 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-21 10:13:57,692 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-21 10:13:57,692 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-21 10:13:57,693 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-21 10:13:57,693 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1557406679_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-21 10:13:57,700 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-21 10:13:57,701 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-21 10:13:57,701 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@2aad26ca in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/local-export-1689934391915/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/local-export-1689934391915/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-21 10:13:57,701 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/local-export-1689934391915/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-21 10:13:57,701 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/local-export-1689934391915/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-21 10:13:57,721 INFO [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-21 10:13:57,722 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testConsecutiveExports 2023-07-21 10:13:57,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-21 10:13:57,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-21 10:13:57,734 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934437734"}]},"ts":"1689934437734"} 2023-07-21 10:13:57,742 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-21 10:13:57,744 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-21 10:13:57,746 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b40717d940e8fa490046ad11990fb125, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5a1dacc820fac98b67ec8c7a22cc4518, UNASSIGN}] 2023-07-21 10:13:57,753 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5a1dacc820fac98b67ec8c7a22cc4518, UNASSIGN 2023-07-21 10:13:57,755 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b40717d940e8fa490046ad11990fb125, UNASSIGN 2023-07-21 10:13:57,756 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=5a1dacc820fac98b67ec8c7a22cc4518, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:57,756 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689934389981.5a1dacc820fac98b67ec8c7a22cc4518.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689934437756"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934437756"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934437756"}]},"ts":"1689934437756"} 2023-07-21 10:13:57,757 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=b40717d940e8fa490046ad11990fb125, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:13:57,757 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689934389981.b40717d940e8fa490046ad11990fb125.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689934437757"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934437757"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934437757"}]},"ts":"1689934437757"} 2023-07-21 10:13:57,767 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 5a1dacc820fac98b67ec8c7a22cc4518, server=jenkins-hbase17.apache.org,36809,1689934328937}] 2023-07-21 10:13:57,770 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure b40717d940e8fa490046ad11990fb125, server=jenkins-hbase17.apache.org,38751,1689934329069}] 2023-07-21 10:13:57,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-21 10:13:57,919 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 5a1dacc820fac98b67ec8c7a22cc4518 2023-07-21 10:13:57,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 5a1dacc820fac98b67ec8c7a22cc4518, disabling compactions & flushes 2023-07-21 10:13:57,920 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689934389981.5a1dacc820fac98b67ec8c7a22cc4518. 2023-07-21 10:13:57,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689934389981.5a1dacc820fac98b67ec8c7a22cc4518. 2023-07-21 10:13:57,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689934389981.5a1dacc820fac98b67ec8c7a22cc4518. after waiting 0 ms 2023-07-21 10:13:57,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689934389981.5a1dacc820fac98b67ec8c7a22cc4518. 2023-07-21 10:13:57,929 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close b40717d940e8fa490046ad11990fb125 2023-07-21 10:13:57,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing b40717d940e8fa490046ad11990fb125, disabling compactions & flushes 2023-07-21 10:13:57,929 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689934389981.b40717d940e8fa490046ad11990fb125. 2023-07-21 10:13:57,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689934389981.b40717d940e8fa490046ad11990fb125. 2023-07-21 10:13:57,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689934389981.b40717d940e8fa490046ad11990fb125. after waiting 0 ms 2023-07-21 10:13:57,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689934389981.b40717d940e8fa490046ad11990fb125. 2023-07-21 10:13:58,008 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testConsecutiveExports/5a1dacc820fac98b67ec8c7a22cc4518/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 10:13:58,009 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:13:58,026 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689934389981.5a1dacc820fac98b67ec8c7a22cc4518. 2023-07-21 10:13:58,026 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 5a1dacc820fac98b67ec8c7a22cc4518: 2023-07-21 10:13:58,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testConsecutiveExports/b40717d940e8fa490046ad11990fb125/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 10:13:58,033 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=5a1dacc820fac98b67ec8c7a22cc4518, regionState=CLOSED 2023-07-21 10:13:58,033 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689934389981.5a1dacc820fac98b67ec8c7a22cc4518.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689934438033"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934438033"}]},"ts":"1689934438033"} 2023-07-21 10:13:58,035 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 5a1dacc820fac98b67ec8c7a22cc4518 2023-07-21 10:13:58,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-21 10:13:58,038 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:13:58,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689934389981.b40717d940e8fa490046ad11990fb125. 2023-07-21 10:13:58,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for b40717d940e8fa490046ad11990fb125: 2023-07-21 10:13:58,057 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed b40717d940e8fa490046ad11990fb125 2023-07-21 10:13:58,060 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=b40717d940e8fa490046ad11990fb125, regionState=CLOSED 2023-07-21 10:13:58,060 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689934389981.b40717d940e8fa490046ad11990fb125.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689934438060"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934438060"}]},"ts":"1689934438060"} 2023-07-21 10:13:58,061 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-21 10:13:58,061 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 5a1dacc820fac98b67ec8c7a22cc4518, server=jenkins-hbase17.apache.org,36809,1689934328937 in 278 msec 2023-07-21 10:13:58,068 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5a1dacc820fac98b67ec8c7a22cc4518, UNASSIGN in 315 msec 2023-07-21 10:13:58,080 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-21 10:13:58,080 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure b40717d940e8fa490046ad11990fb125, server=jenkins-hbase17.apache.org,38751,1689934329069 in 302 msec 2023-07-21 10:13:58,084 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-21 10:13:58,084 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b40717d940e8fa490046ad11990fb125, UNASSIGN in 334 msec 2023-07-21 10:13:58,086 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934438085"}]},"ts":"1689934438085"} 2023-07-21 10:13:58,090 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-21 10:13:58,094 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-21 10:13:58,098 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 373 msec 2023-07-21 10:13:58,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-21 10:13:58,343 INFO [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-21 10:13:58,344 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testConsecutiveExports 2023-07-21 10:13:58,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-21 10:13:58,357 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-21 10:13:58,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-21 10:13:58,361 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-21 10:13:58,362 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37151] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-21 10:13:58,366 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 10:13:58,366 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 10:13:58,367 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 10:13:58,368 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-21 10:13:58,368 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-21 10:13:58,368 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 10:13:58,368 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-21 10:13:58,369 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 10:13:58,369 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:13:58,369 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 10:13:58,369 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-21 10:13:58,370 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:13:58,370 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-21 10:13:58,370 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:13:58,370 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 10:13:58,370 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:13:58,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-21 10:13:58,387 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testConsecutiveExports/b40717d940e8fa490046ad11990fb125 2023-07-21 10:13:58,387 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testConsecutiveExports/5a1dacc820fac98b67ec8c7a22cc4518 2023-07-21 10:13:58,392 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testConsecutiveExports/5a1dacc820fac98b67ec8c7a22cc4518/cf, FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testConsecutiveExports/5a1dacc820fac98b67ec8c7a22cc4518/recovered.edits] 2023-07-21 10:13:58,398 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testConsecutiveExports/b40717d940e8fa490046ad11990fb125/cf, FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testConsecutiveExports/b40717d940e8fa490046ad11990fb125/recovered.edits] 2023-07-21 10:13:58,407 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testConsecutiveExports/5a1dacc820fac98b67ec8c7a22cc4518/cf/8d783574d3e442e595934d5c8a8c0013 to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/archive/data/default/testtb-testConsecutiveExports/5a1dacc820fac98b67ec8c7a22cc4518/cf/8d783574d3e442e595934d5c8a8c0013 2023-07-21 10:13:58,413 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testConsecutiveExports/5a1dacc820fac98b67ec8c7a22cc4518/recovered.edits/9.seqid to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/archive/data/default/testtb-testConsecutiveExports/5a1dacc820fac98b67ec8c7a22cc4518/recovered.edits/9.seqid 2023-07-21 10:13:58,414 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testConsecutiveExports/5a1dacc820fac98b67ec8c7a22cc4518 2023-07-21 10:13:58,417 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testConsecutiveExports/b40717d940e8fa490046ad11990fb125/cf/e3acaf4e30e3451a885b461f8e9c52e8 to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/archive/data/default/testtb-testConsecutiveExports/b40717d940e8fa490046ad11990fb125/cf/e3acaf4e30e3451a885b461f8e9c52e8 2023-07-21 10:13:58,420 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testConsecutiveExports/b40717d940e8fa490046ad11990fb125/recovered.edits/9.seqid to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/archive/data/default/testtb-testConsecutiveExports/b40717d940e8fa490046ad11990fb125/recovered.edits/9.seqid 2023-07-21 10:13:58,420 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testConsecutiveExports/b40717d940e8fa490046ad11990fb125 2023-07-21 10:13:58,421 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-21 10:13:58,421 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-21 10:13:58,422 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-21 10:13:58,443 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230721c67a82bf8c8d46ff8f6403cc9ce4e3bd to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230721c67a82bf8c8d46ff8f6403cc9ce4e3bd 2023-07-21 10:13:58,450 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307217f5fc18da05445a989067b648b9f5242 to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307217f5fc18da05445a989067b648b9f5242 2023-07-21 10:13:58,451 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-21 10:13:58,458 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-21 10:13:58,471 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-21 10:13:58,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-21 10:13:58,495 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-21 10:13:58,504 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-21 10:13:58,505 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-21 10:13:58,505 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689934389981.b40717d940e8fa490046ad11990fb125.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689934438505"}]},"ts":"9223372036854775807"} 2023-07-21 10:13:58,505 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689934389981.5a1dacc820fac98b67ec8c7a22cc4518.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689934438505"}]},"ts":"9223372036854775807"} 2023-07-21 10:13:58,524 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-21 10:13:58,524 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b40717d940e8fa490046ad11990fb125, NAME => 'testtb-testConsecutiveExports,,1689934389981.b40717d940e8fa490046ad11990fb125.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 5a1dacc820fac98b67ec8c7a22cc4518, NAME => 'testtb-testConsecutiveExports,1,1689934389981.5a1dacc820fac98b67ec8c7a22cc4518.', STARTKEY => '1', ENDKEY => ''}] 2023-07-21 10:13:58,524 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-21 10:13:58,525 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689934438524"}]},"ts":"9223372036854775807"} 2023-07-21 10:13:58,527 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-21 10:13:58,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-21 10:13:58,918 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-21 10:13:58,924 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 574 msec 2023-07-21 10:13:58,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-21 10:13:58,991 INFO [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-21 10:13:59,021 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-21 10:13:59,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:59,035 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testConsecutiveExports" 2023-07-21 10:13:59,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-21 10:13:59,068 INFO [Listener at jenkins-hbase17.apache.org/42227] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=743 (was 751), OpenFileDescriptor=898 (was 923), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1259 (was 847) - SystemLoadAverage LEAK? -, ProcessCount=196 (was 193) - ProcessCount LEAK? -, AvailableMemoryMB=872 (was 1203) 2023-07-21 10:13:59,068 WARN [Listener at jenkins-hbase17.apache.org/42227] hbase.ResourceChecker(130): Thread=743 is superior to 500 2023-07-21 10:13:59,095 INFO [Listener at jenkins-hbase17.apache.org/42227] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=743, OpenFileDescriptor=898, MaxFileDescriptor=60000, SystemLoadAverage=1259, ProcessCount=196, AvailableMemoryMB=872 2023-07-21 10:13:59,095 WARN [Listener at jenkins-hbase17.apache.org/42227] hbase.ResourceChecker(130): Thread=743 is superior to 500 2023-07-21 10:13:59,100 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-21 10:13:59,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:59,136 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 10:13:59,137 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-21 10:13:59,138 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 10:13:59,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-21 10:13:59,141 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dfb877ee2acda63388da237538597f0b 2023-07-21 10:13:59,145 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dfb877ee2acda63388da237538597f0b empty. 2023-07-21 10:13:59,145 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/86c0cdabf731340ea1b965371f5387ef 2023-07-21 10:13:59,146 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dfb877ee2acda63388da237538597f0b 2023-07-21 10:13:59,149 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/86c0cdabf731340ea1b965371f5387ef empty. 2023-07-21 10:13:59,150 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/86c0cdabf731340ea1b965371f5387ef 2023-07-21 10:13:59,150 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-21 10:13:59,188 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-21 10:13:59,189 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => dfb877ee2acda63388da237538597f0b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689934439099.dfb877ee2acda63388da237538597f0b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp 2023-07-21 10:13:59,194 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 86c0cdabf731340ea1b965371f5387ef, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689934439099.86c0cdabf731340ea1b965371f5387ef.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp 2023-07-21 10:13:59,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-21 10:13:59,244 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689934439099.dfb877ee2acda63388da237538597f0b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:13:59,245 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing dfb877ee2acda63388da237538597f0b, disabling compactions & flushes 2023-07-21 10:13:59,245 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689934439099.dfb877ee2acda63388da237538597f0b. 2023-07-21 10:13:59,245 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689934439099.dfb877ee2acda63388da237538597f0b. 2023-07-21 10:13:59,245 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689934439099.dfb877ee2acda63388da237538597f0b. after waiting 0 ms 2023-07-21 10:13:59,245 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689934439099.dfb877ee2acda63388da237538597f0b. 2023-07-21 10:13:59,245 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689934439099.dfb877ee2acda63388da237538597f0b. 2023-07-21 10:13:59,245 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for dfb877ee2acda63388da237538597f0b: 2023-07-21 10:13:59,288 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689934439099.86c0cdabf731340ea1b965371f5387ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:13:59,288 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 86c0cdabf731340ea1b965371f5387ef, disabling compactions & flushes 2023-07-21 10:13:59,288 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689934439099.86c0cdabf731340ea1b965371f5387ef. 2023-07-21 10:13:59,288 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689934439099.86c0cdabf731340ea1b965371f5387ef. 2023-07-21 10:13:59,288 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689934439099.86c0cdabf731340ea1b965371f5387ef. after waiting 0 ms 2023-07-21 10:13:59,288 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689934439099.86c0cdabf731340ea1b965371f5387ef. 2023-07-21 10:13:59,288 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689934439099.86c0cdabf731340ea1b965371f5387ef. 2023-07-21 10:13:59,288 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 86c0cdabf731340ea1b965371f5387ef: 2023-07-21 10:13:59,293 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 10:13:59,297 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689934439099.dfb877ee2acda63388da237538597f0b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689934439297"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934439297"}]},"ts":"1689934439297"} 2023-07-21 10:13:59,297 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689934439099.86c0cdabf731340ea1b965371f5387ef.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689934439297"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934439297"}]},"ts":"1689934439297"} 2023-07-21 10:13:59,310 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-21 10:13:59,314 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 10:13:59,314 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934439314"}]},"ts":"1689934439314"} 2023-07-21 10:13:59,318 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-21 10:13:59,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-21 10:13:59,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-21 10:13:59,767 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-21 10:13:59,768 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 10:13:59,769 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 10:13:59,769 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 10:13:59,769 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 10:13:59,769 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=dfb877ee2acda63388da237538597f0b, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=86c0cdabf731340ea1b965371f5387ef, ASSIGN}] 2023-07-21 10:13:59,772 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=86c0cdabf731340ea1b965371f5387ef, ASSIGN 2023-07-21 10:13:59,773 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=dfb877ee2acda63388da237538597f0b, ASSIGN 2023-07-21 10:13:59,774 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=dfb877ee2acda63388da237538597f0b, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,36809,1689934328937; forceNewPlan=false, retain=false 2023-07-21 10:13:59,774 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=86c0cdabf731340ea1b965371f5387ef, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,37151,1689934329015; forceNewPlan=false, retain=false 2023-07-21 10:13:59,925 INFO [jenkins-hbase17:35385] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-21 10:13:59,928 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=dfb877ee2acda63388da237538597f0b, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:13:59,928 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=86c0cdabf731340ea1b965371f5387ef, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:13:59,928 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689934439099.dfb877ee2acda63388da237538597f0b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689934439928"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934439928"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934439928"}]},"ts":"1689934439928"} 2023-07-21 10:13:59,928 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689934439099.86c0cdabf731340ea1b965371f5387ef.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689934439928"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934439928"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934439928"}]},"ts":"1689934439928"} 2023-07-21 10:13:59,944 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure dfb877ee2acda63388da237538597f0b, server=jenkins-hbase17.apache.org,36809,1689934328937}] 2023-07-21 10:13:59,946 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 86c0cdabf731340ea1b965371f5387ef, server=jenkins-hbase17.apache.org,37151,1689934329015}] 2023-07-21 10:14:00,101 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689934439099.dfb877ee2acda63388da237538597f0b. 2023-07-21 10:14:00,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dfb877ee2acda63388da237538597f0b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689934439099.dfb877ee2acda63388da237538597f0b.', STARTKEY => '', ENDKEY => '1'} 2023-07-21 10:14:00,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689934439099.dfb877ee2acda63388da237538597f0b. service=AccessControlService 2023-07-21 10:14:00,102 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:14:00,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion dfb877ee2acda63388da237538597f0b 2023-07-21 10:14:00,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689934439099.dfb877ee2acda63388da237538597f0b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:14:00,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for dfb877ee2acda63388da237538597f0b 2023-07-21 10:14:00,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for dfb877ee2acda63388da237538597f0b 2023-07-21 10:14:00,109 INFO [StoreOpener-dfb877ee2acda63388da237538597f0b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region dfb877ee2acda63388da237538597f0b 2023-07-21 10:14:00,110 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689934439099.86c0cdabf731340ea1b965371f5387ef. 2023-07-21 10:14:00,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 86c0cdabf731340ea1b965371f5387ef, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689934439099.86c0cdabf731340ea1b965371f5387ef.', STARTKEY => '1', ENDKEY => ''} 2023-07-21 10:14:00,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689934439099.86c0cdabf731340ea1b965371f5387ef. service=AccessControlService 2023-07-21 10:14:00,111 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:14:00,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 86c0cdabf731340ea1b965371f5387ef 2023-07-21 10:14:00,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689934439099.86c0cdabf731340ea1b965371f5387ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:14:00,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 86c0cdabf731340ea1b965371f5387ef 2023-07-21 10:14:00,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 86c0cdabf731340ea1b965371f5387ef 2023-07-21 10:14:00,116 DEBUG [StoreOpener-dfb877ee2acda63388da237538597f0b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion/dfb877ee2acda63388da237538597f0b/cf 2023-07-21 10:14:00,117 DEBUG [StoreOpener-dfb877ee2acda63388da237538597f0b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion/dfb877ee2acda63388da237538597f0b/cf 2023-07-21 10:14:00,117 INFO [StoreOpener-86c0cdabf731340ea1b965371f5387ef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 86c0cdabf731340ea1b965371f5387ef 2023-07-21 10:14:00,118 INFO [StoreOpener-dfb877ee2acda63388da237538597f0b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dfb877ee2acda63388da237538597f0b columnFamilyName cf 2023-07-21 10:14:00,121 INFO [StoreOpener-dfb877ee2acda63388da237538597f0b-1] regionserver.HStore(310): Store=dfb877ee2acda63388da237538597f0b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:14:00,122 DEBUG [StoreOpener-86c0cdabf731340ea1b965371f5387ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion/86c0cdabf731340ea1b965371f5387ef/cf 2023-07-21 10:14:00,122 DEBUG [StoreOpener-86c0cdabf731340ea1b965371f5387ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion/86c0cdabf731340ea1b965371f5387ef/cf 2023-07-21 10:14:00,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion/dfb877ee2acda63388da237538597f0b 2023-07-21 10:14:00,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion/dfb877ee2acda63388da237538597f0b 2023-07-21 10:14:00,124 INFO [StoreOpener-86c0cdabf731340ea1b965371f5387ef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 86c0cdabf731340ea1b965371f5387ef columnFamilyName cf 2023-07-21 10:14:00,125 INFO [StoreOpener-86c0cdabf731340ea1b965371f5387ef-1] regionserver.HStore(310): Store=86c0cdabf731340ea1b965371f5387ef/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:14:00,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for dfb877ee2acda63388da237538597f0b 2023-07-21 10:14:00,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion/86c0cdabf731340ea1b965371f5387ef 2023-07-21 10:14:00,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion/86c0cdabf731340ea1b965371f5387ef 2023-07-21 10:14:00,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion/dfb877ee2acda63388da237538597f0b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 10:14:00,129 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened dfb877ee2acda63388da237538597f0b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71994401, jitterRate=0.0728001743555069}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 10:14:00,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for dfb877ee2acda63388da237538597f0b: 2023-07-21 10:14:00,130 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689934439099.dfb877ee2acda63388da237538597f0b., pid=60, masterSystemTime=1689934440098 2023-07-21 10:14:00,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689934439099.dfb877ee2acda63388da237538597f0b. 2023-07-21 10:14:00,133 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689934439099.dfb877ee2acda63388da237538597f0b. 2023-07-21 10:14:00,134 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=dfb877ee2acda63388da237538597f0b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:00,134 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689934439099.dfb877ee2acda63388da237538597f0b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689934440134"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689934440134"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689934440134"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689934440134"}]},"ts":"1689934440134"} 2023-07-21 10:14:00,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 86c0cdabf731340ea1b965371f5387ef 2023-07-21 10:14:00,143 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-21 10:14:00,143 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure dfb877ee2acda63388da237538597f0b, server=jenkins-hbase17.apache.org,36809,1689934328937 in 194 msec 2023-07-21 10:14:00,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion/86c0cdabf731340ea1b965371f5387ef/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 10:14:00,152 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=dfb877ee2acda63388da237538597f0b, ASSIGN in 374 msec 2023-07-21 10:14:00,152 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 86c0cdabf731340ea1b965371f5387ef; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75174717, jitterRate=0.1201905757188797}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 10:14:00,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 86c0cdabf731340ea1b965371f5387ef: 2023-07-21 10:14:00,153 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689934439099.86c0cdabf731340ea1b965371f5387ef., pid=61, masterSystemTime=1689934440102 2023-07-21 10:14:00,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689934439099.86c0cdabf731340ea1b965371f5387ef. 2023-07-21 10:14:00,155 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689934439099.86c0cdabf731340ea1b965371f5387ef. 2023-07-21 10:14:00,156 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=86c0cdabf731340ea1b965371f5387ef, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:00,156 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689934439099.86c0cdabf731340ea1b965371f5387ef.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689934440156"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689934440156"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689934440156"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689934440156"}]},"ts":"1689934440156"} 2023-07-21 10:14:00,162 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-21 10:14:00,162 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 86c0cdabf731340ea1b965371f5387ef, server=jenkins-hbase17.apache.org,37151,1689934329015 in 212 msec 2023-07-21 10:14:00,164 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-21 10:14:00,164 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=86c0cdabf731340ea1b965371f5387ef, ASSIGN in 393 msec 2023-07-21 10:14:00,165 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 10:14:00,165 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934440165"}]},"ts":"1689934440165"} 2023-07-21 10:14:00,167 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-21 10:14:00,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-21 10:14:00,467 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 10:14:00,467 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-21 10:14:00,471 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37151] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-21 10:14:00,474 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-21 10:14:00,637 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:00,640 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:00,640 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:00,641 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:00,647 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 10:14:00,650 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 10:14:00,650 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 10:14:00,651 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 10:14:00,654 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 1.5470 sec 2023-07-21 10:14:01,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-21 10:14:01,247 INFO [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-21 10:14:01,252 DEBUG [Listener at jenkins-hbase17.apache.org/42227] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,253 DEBUG [Listener at jenkins-hbase17.apache.org/42227] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689934439099.dfb877ee2acda63388da237538597f0b. 2023-07-21 10:14:01,254 INFO [Listener at jenkins-hbase17.apache.org/42227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 10:14:01,300 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-21 10:14:01,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689934441300 (current time:1689934441300). 2023-07-21 10:14:01,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 10:14:01,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] zookeeper.ReadOnlyZKClient(139): Connect 0x09973581 to 127.0.0.1:56971 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:14:01,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ff6a3e8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:14:01,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:14:01,356 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:52450, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:14:01,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09973581 to 127.0.0.1:56971 2023-07-21 10:14:01,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:14:01,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] zookeeper.ReadOnlyZKClient(139): Connect 0x4be6d27c to 127.0.0.1:56971 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:14:01,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7bedcdbc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:14:01,384 DEBUG [hconnection-0x718ed8ca-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:14:01,386 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:52466, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:14:01,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:14:01,413 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:47414, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:14:01,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4be6d27c to 127.0.0.1:56971 2023-07-21 10:14:01,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:14:01,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-21 10:14:01,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 10:14:01,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-21 10:14:01,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-21 10:14:01,437 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-21 10:14:01,445 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689935041445 2023-07-21 10:14:01,445 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-21 10:14:01,453 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 10:14:01,453 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 10:14:01,462 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-21 10:14:01,463 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-21 10:14:01,467 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 35 msec 2023-07-21 10:14:01,469 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-21 10:14:01,473 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689935041473 2023-07-21 10:14:01,519 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,519 INFO [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-21 10:14:01,519 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:14:01,521 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-21 10:14:01,521 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-21 10:14:01,521 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,522 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,522 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:01,522 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:01,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:01,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:01,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:01,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:01,523 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:01,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,523 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,524 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,524 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:01,524 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:01,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-21 10:14:01,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,524 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:01,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:01,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:01,524 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-21 10:14:01,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,525 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-21 10:14:01,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,525 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-21 10:14:01,526 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,526 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-21 10:14:01,526 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:14:01,526 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,526 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-21 10:14:01,526 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:14:01,528 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-21 10:14:01,528 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-21 10:14:01,528 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36809,1689934328937' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-21 10:14:01,530 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-21 10:14:01,530 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-21 10:14:01,530 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,38751,1689934329069' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-21 10:14:01,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-21 10:14:01,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,542 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-21 10:14:01,542 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:01,543 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 10:14:01,544 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:01,544 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:01,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:01,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:01,544 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:01,545 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,545 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:14:01,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:01,545 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,545 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:14:01,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:01,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:01,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:01,547 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,36809,1689934328937' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-21 10:14:01,547 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b1a5ec4[Count = 1] remaining members to acquire global barrier 2023-07-21 10:14:01,553 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:14:01,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-21 10:14:01,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:14:01,555 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 10:14:01,559 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,560 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-21 10:14:01,560 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:14:01,562 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-21 10:14:01,562 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-21 10:14:01,563 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,37151,1689934329015' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-21 10:14:01,567 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,568 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,568 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:14:01,568 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:01,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:01,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:01,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:01,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:01,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:01,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:01,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:01,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:01,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:01,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,37151,1689934329015' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-21 10:14:01,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b1a5ec4[Count = 0] remaining members to acquire global barrier 2023-07-21 10:14:01,584 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-21 10:14:01,584 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,585 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,585 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,585 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,586 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-21 10:14:01,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,586 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:14:01,586 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:14:01,586 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-21 10:14:01,586 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689934439099.dfb877ee2acda63388da237538597f0b. 2023-07-21 10:14:01,586 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:01,586 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-21 10:14:01,586 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-21 10:14:01,586 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,38751,1689934329069' in zk 2023-07-21 10:14:01,586 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689934439099.dfb877ee2acda63388da237538597f0b. started... 2023-07-21 10:14:01,586 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:14:01,586 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:14:01,586 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:01,586 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 10:14:01,587 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dfb877ee2acda63388da237538597f0b: 2023-07-21 10:14:01,587 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689934439099.86c0cdabf731340ea1b965371f5387ef. 2023-07-21 10:14:01,587 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689934439099.86c0cdabf731340ea1b965371f5387ef. started... 2023-07-21 10:14:01,587 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689934439099.dfb877ee2acda63388da237538597f0b.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,587 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:14:01,589 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 10:14:01,589 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-21 10:14:01,590 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:14:01,590 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-21 10:14:01,594 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 86c0cdabf731340ea1b965371f5387ef: 2023-07-21 10:14:01,594 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689934439099.86c0cdabf731340ea1b965371f5387ef.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,595 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:14:01,595 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 10:14:01,664 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689934439099.86c0cdabf731340ea1b965371f5387ef. completed. 2023-07-21 10:14:01,664 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689934439099.86c0cdabf731340ea1b965371f5387ef. 2023-07-21 10:14:01,665 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:14:01,665 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:14:01,665 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:01,665 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-21 10:14:01,665 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,37151,1689934329015' in zk 2023-07-21 10:14:01,670 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689934439099.dfb877ee2acda63388da237538597f0b. completed. 2023-07-21 10:14:01,670 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689934439099.dfb877ee2acda63388da237538597f0b. 2023-07-21 10:14:01,670 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:14:01,670 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:14:01,670 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:01,671 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-21 10:14:01,671 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,36809,1689934328937' in zk 2023-07-21 10:14:01,672 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-21 10:14:01,672 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:14:01,672 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:01,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:01,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:01,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:01,672 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-21 10:14:01,676 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:01,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:01,676 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-21 10:14:01,676 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:14:01,741 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-21 10:14:01,756 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:14:01,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-21 10:14:01,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:14:01,759 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 10:14:01,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:01,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:01,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:01,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:01,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:01,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:01,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:01,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:01,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase17.apache.org,36809,1689934328937': 2023-07-21 10:14:01,816 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,36809,1689934328937' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-21 10:14:01,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:01,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:01,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:01,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:01,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:01,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:01,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:01,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:01,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:01,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:01,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:01,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:01,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase17.apache.org,37151,1689934329015': 2023-07-21 10:14:01,823 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,37151,1689934329015' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-21 10:14:01,824 INFO [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-21 10:14:01,824 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 10:14:01,824 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 10:14:01,824 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,824 INFO [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 10:14:01,825 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,825 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,825 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,825 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:01,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,825 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:01,825 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:01,825 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:01,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:01,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:01,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:01,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:01,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:01,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:01,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:01,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:01,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,829 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:01,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:01,830 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:01,831 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:01,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:01,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:01,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:01,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:01,836 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:01,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,836 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:01,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:01,837 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:01,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:01,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:01,842 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:01,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:01,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:01,843 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:01,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:01,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:01,844 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:01,844 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:01,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:01,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:01,844 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:01,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:01,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:01,845 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:01,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:01,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:01,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:01,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:01,846 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:01,847 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,847 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:01,847 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:01,847 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,847 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:01,847 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,847 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:01,847 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:01,847 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,848 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,848 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:14:01,848 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,848 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,848 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,848 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-21 10:14:01,851 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-21 10:14:01,914 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,918 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,060 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:14:02,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-21 10:14:02,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:14:02,063 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-21 10:14:02,084 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,155 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-21 10:14:02,155 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,155 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,156 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689934441445Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689934441914 (+469 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689934441914Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689934441916 (+2 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689934441961 (+45 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689934442060 (+99 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689934442155 (+95 ms) 2023-07-21 10:14:02,159 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-21 10:14:02,161 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 711 msec 2023-07-21 10:14:02,225 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934340509_0004_000001 (auth:SIMPLE) 2023-07-21 10:14:02,563 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:14:02,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-21 10:14:02,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 10:14:02,570 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36809] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689934439099.dfb877ee2acda63388da237538597f0b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 10:14:02,571 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37151] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689934439099.86c0cdabf731340ea1b965371f5387ef. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 10:14:02,575 DEBUG [Listener at jenkins-hbase17.apache.org/42227] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,575 DEBUG [Listener at jenkins-hbase17.apache.org/42227] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689934439099.dfb877ee2acda63388da237538597f0b. 2023-07-21 10:14:02,576 INFO [Listener at jenkins-hbase17.apache.org/42227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 10:14:02,589 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-21 10:14:02,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689934442589 (current time:1689934442589). 2023-07-21 10:14:02,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 10:14:02,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] zookeeper.ReadOnlyZKClient(139): Connect 0x21e466cd to 127.0.0.1:56971 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:14:02,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d971a32, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:14:02,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:14:02,599 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:52474, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:14:02,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x21e466cd to 127.0.0.1:56971 2023-07-21 10:14:02,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:14:02,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] zookeeper.ReadOnlyZKClient(139): Connect 0x02964318 to 127.0.0.1:56971 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:14:02,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20cd092c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:14:02,611 DEBUG [hconnection-0x6ffe6a97-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:14:02,615 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:52490, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:14:02,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:14:02,625 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:47418, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:14:02,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x02964318 to 127.0.0.1:56971 2023-07-21 10:14:02,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:14:02,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-21 10:14:02,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 10:14:02,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-21 10:14:02,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-21 10:14:02,632 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-21 10:14:02,633 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689935042633 2023-07-21 10:14:02,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-21 10:14:02,633 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,635 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 10:14:02,635 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 10:14:02,635 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-21 10:14:02,637 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-21 10:14:02,639 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 8 msec 2023-07-21 10:14:02,640 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-21 10:14:02,641 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689935042641 2023-07-21 10:14:02,662 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,662 INFO [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-21 10:14:02,662 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:14:02,663 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-21 10:14:02,663 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-21 10:14:02,664 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,664 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,665 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:02,665 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:02,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:02,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:02,665 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:02,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:02,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:02,665 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:02,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:02,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:02,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,666 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:02,666 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:02,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,666 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,666 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,667 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-21 10:14:02,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-21 10:14:02,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-21 10:14:02,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,667 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-21 10:14:02,667 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-21 10:14:02,667 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-21 10:14:02,668 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:02,668 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 10:14:02,669 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,669 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,670 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-21 10:14:02,670 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-21 10:14:02,670 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:14:02,670 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:14:02,671 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,673 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-21 10:14:02,674 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-21 10:14:02,673 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-21 10:14:02,674 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-21 10:14:02,674 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:14:02,674 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-21 10:14:02,675 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-21 10:14:02,675 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-21 10:14:02,675 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36809,1689934328937' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-21 10:14:02,674 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,38751,1689934329069' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-21 10:14:02,675 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,37151,1689934329015' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-21 10:14:02,676 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:02,676 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:02,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:02,676 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,676 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:02,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:02,676 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,677 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,677 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:14:02,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:02,677 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,677 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:14:02,677 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,677 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:14:02,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:02,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:02,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:02,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:02,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:02,679 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,36809,1689934328937' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-21 10:14:02,679 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9963d[Count = 1] remaining members to acquire global barrier 2023-07-21 10:14:02,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:02,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:02,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:02,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:02,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:02,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:02,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:02,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:02,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:02,688 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,37151,1689934329015' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-21 10:14:02,688 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9963d[Count = 0] remaining members to acquire global barrier 2023-07-21 10:14:02,688 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-21 10:14:02,688 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,689 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,689 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,689 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,689 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-21 10:14:02,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,689 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-21 10:14:02,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,689 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,38751,1689934329069' in zk 2023-07-21 10:14:02,689 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:02,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,689 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-21 10:14:02,690 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-21 10:14:02,690 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:02,690 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 10:14:02,691 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-21 10:14:02,691 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:14:02,691 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-21 10:14:02,693 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:14:02,697 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:14:02,697 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689934439099.86c0cdabf731340ea1b965371f5387ef. 2023-07-21 10:14:02,696 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689934439099.dfb877ee2acda63388da237538597f0b. 2023-07-21 10:14:02,696 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:14:02,697 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689934439099.dfb877ee2acda63388da237538597f0b. started... 2023-07-21 10:14:02,697 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689934439099.86c0cdabf731340ea1b965371f5387ef. started... 2023-07-21 10:14:02,697 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:14:02,697 INFO [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.HRegion(2745): Flushing dfb877ee2acda63388da237538597f0b 1/1 column families, dataSize=65 B heapSize=400 B 2023-07-21 10:14:02,697 INFO [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 86c0cdabf731340ea1b965371f5387ef 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-07-21 10:14:02,735 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:14:02,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-21 10:14:02,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:14:02,736 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 10:14:02,767 INFO [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230721821a4fb0d1e54710b906715e8d671d22 to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230721821a4fb0d1e54710b906715e8d671d22 2023-07-21 10:14:02,786 INFO [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230721564c24bd85f0438f8d1f8a12f7f83e54 to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230721564c24bd85f0438f8d1f8a12f7f83e54 2023-07-21 10:14:02,787 INFO [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=65, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion/dfb877ee2acda63388da237538597f0b/.tmp/cf/7e8c5a1d184e44e5a0f9bd1b02aca158 2023-07-21 10:14:02,793 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion/dfb877ee2acda63388da237538597f0b/.tmp/cf/7e8c5a1d184e44e5a0f9bd1b02aca158 as hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion/dfb877ee2acda63388da237538597f0b/cf/7e8c5a1d184e44e5a0f9bd1b02aca158 2023-07-21 10:14:02,794 INFO [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.2 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion/86c0cdabf731340ea1b965371f5387ef/.tmp/cf/0adcd5a097a944de8545b3f399efa92d 2023-07-21 10:14:02,799 INFO [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion/dfb877ee2acda63388da237538597f0b/cf/7e8c5a1d184e44e5a0f9bd1b02aca158, entries=1, sequenceid=6, filesize=5.1 K 2023-07-21 10:14:02,799 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion/86c0cdabf731340ea1b965371f5387ef/.tmp/cf/0adcd5a097a944de8545b3f399efa92d as hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion/86c0cdabf731340ea1b965371f5387ef/cf/0adcd5a097a944de8545b3f399efa92d 2023-07-21 10:14:02,799 INFO [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for dfb877ee2acda63388da237538597f0b in 102ms, sequenceid=6, compaction requested=false 2023-07-21 10:14:02,801 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dfb877ee2acda63388da237538597f0b: 2023-07-21 10:14:02,801 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689934439099.dfb877ee2acda63388da237538597f0b.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,801 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:14:02,801 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion/dfb877ee2acda63388da237538597f0b/cf/7e8c5a1d184e44e5a0f9bd1b02aca158] hfiles 2023-07-21 10:14:02,801 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion/dfb877ee2acda63388da237538597f0b/cf/7e8c5a1d184e44e5a0f9bd1b02aca158 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,808 INFO [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion/86c0cdabf731340ea1b965371f5387ef/cf/0adcd5a097a944de8545b3f399efa92d, entries=49, sequenceid=6, filesize=13.9 K 2023-07-21 10:14:02,809 INFO [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for 86c0cdabf731340ea1b965371f5387ef in 112ms, sequenceid=6, compaction requested=false 2023-07-21 10:14:02,809 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 86c0cdabf731340ea1b965371f5387ef: 2023-07-21 10:14:02,809 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689934439099.86c0cdabf731340ea1b965371f5387ef.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,810 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:14:02,810 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion/86c0cdabf731340ea1b965371f5387ef/cf/0adcd5a097a944de8545b3f399efa92d] hfiles 2023-07-21 10:14:02,810 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion/86c0cdabf731340ea1b965371f5387ef/cf/0adcd5a097a944de8545b3f399efa92d for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,824 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689934439099.dfb877ee2acda63388da237538597f0b. completed. 2023-07-21 10:14:02,824 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689934439099.dfb877ee2acda63388da237538597f0b. 2023-07-21 10:14:02,824 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:14:02,824 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:14:02,824 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:02,831 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-21 10:14:02,831 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,36809,1689934328937' in zk 2023-07-21 10:14:02,837 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:02,837 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-21 10:14:02,837 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:14:02,837 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-21 10:14:02,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:02,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:02,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:02,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:02,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:02,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,846 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689934439099.86c0cdabf731340ea1b965371f5387ef. completed. 2023-07-21 10:14:02,846 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689934439099.86c0cdabf731340ea1b965371f5387ef. 2023-07-21 10:14:02,846 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:14:02,846 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:14:02,846 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:02,846 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-21 10:14:02,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:02,846 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,37151,1689934329015' in zk 2023-07-21 10:14:02,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:02,850 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:02,850 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-21 10:14:02,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:02,850 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:14:02,850 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-21 10:14:02,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:02,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:02,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:02,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:02,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase17.apache.org,36809,1689934328937': 2023-07-21 10:14:02,854 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,36809,1689934328937' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-21 10:14:02,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:02,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:02,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:02,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:02,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:02,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:02,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:02,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:02,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:02,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:02,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:02,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:02,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase17.apache.org,37151,1689934329015': 2023-07-21 10:14:02,858 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,37151,1689934329015' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-21 10:14:02,858 INFO [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-21 10:14:02,858 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 10:14:02,858 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 10:14:02,858 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,858 INFO [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 10:14:02,859 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,859 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,859 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,859 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:02,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,859 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:02,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,860 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:02,860 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:02,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:02,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:02,860 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:02,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:02,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:02,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:02,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:02,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,861 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:02,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,861 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:02,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:02,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:02,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:02,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,863 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:02,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:02,863 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:02,864 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:02,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:02,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:02,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:02,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:02,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:02,867 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:02,867 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:02,867 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,867 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:02,867 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:02,867 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:02,867 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:02,867 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:02,867 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:02,867 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:02,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:02,867 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:02,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:02,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:02,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:02,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:02,868 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion because node does not exist (not an error) 2023-07-21 10:14:02,867 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:02,867 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:14:02,867 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:02,870 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:02,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:02,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:02,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,871 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,871 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-21 10:14:02,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:02,871 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:02,871 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:02,871 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,871 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:02,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:02,873 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230721564c24bd85f0438f8d1f8a12f7f83e54, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230721821a4fb0d1e54710b906715e8d671d22] mob files 2023-07-21 10:14:02,873 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230721564c24bd85f0438f8d1f8a12f7f83e54 2023-07-21 10:14:02,873 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230721821a4fb0d1e54710b906715e8d671d22 2023-07-21 10:14:02,881 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,887 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,910 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,937 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:14:02,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-21 10:14:02,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:14:02,938 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 10:14:02,953 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-21 10:14:02,953 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,954 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:02,954 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689934442633Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689934442881 (+248 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689934442881Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689934442881Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689934442892 (+11 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689934442900 (+8 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689934442953 (+53 ms) 2023-07-21 10:14:02,962 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-21 10:14:02,971 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 327 msec 2023-07-21 10:14:03,238 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:14:03,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-21 10:14:03,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 10:14:03,283 DEBUG [Listener at jenkins-hbase17.apache.org/42227] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-21 10:14:03,293 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:34464, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-21 10:14:03,295 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36809] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-21 10:14:03,299 DEBUG [Listener at jenkins-hbase17.apache.org/42227] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-21 10:14:03,309 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:47422, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-21 10:14:03,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37151] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-21 10:14:03,316 DEBUG [Listener at jenkins-hbase17.apache.org/42227] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-21 10:14:03,330 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:52502, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-21 10:14:03,330 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38751] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-21 10:14:03,333 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-21 10:14:03,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:03,341 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 10:14:03,343 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-21 10:14:03,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-21 10:14:03,344 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 10:14:03,359 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69bf54c501efae9255d672d6c6955706 2023-07-21 10:14:03,361 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b666528e5ac6ac3b135d608e881f349d 2023-07-21 10:14:03,369 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69bf54c501efae9255d672d6c6955706 empty. 2023-07-21 10:14:03,370 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69bf54c501efae9255d672d6c6955706 2023-07-21 10:14:03,373 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b666528e5ac6ac3b135d608e881f349d empty. 2023-07-21 10:14:03,377 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b666528e5ac6ac3b135d608e881f349d 2023-07-21 10:14:03,377 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-21 10:14:03,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-21 10:14:03,471 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-21 10:14:03,472 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 69bf54c501efae9255d672d6c6955706, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443333.69bf54c501efae9255d672d6c6955706.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp 2023-07-21 10:14:03,473 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => b666528e5ac6ac3b135d608e881f349d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934443333.b666528e5ac6ac3b135d608e881f349d.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp 2023-07-21 10:14:03,542 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443333.69bf54c501efae9255d672d6c6955706.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:14:03,542 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 69bf54c501efae9255d672d6c6955706, disabling compactions & flushes 2023-07-21 10:14:03,542 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443333.69bf54c501efae9255d672d6c6955706. 2023-07-21 10:14:03,542 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443333.69bf54c501efae9255d672d6c6955706. 2023-07-21 10:14:03,542 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443333.69bf54c501efae9255d672d6c6955706. after waiting 0 ms 2023-07-21 10:14:03,542 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443333.69bf54c501efae9255d672d6c6955706. 2023-07-21 10:14:03,542 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443333.69bf54c501efae9255d672d6c6955706. 2023-07-21 10:14:03,542 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 69bf54c501efae9255d672d6c6955706: 2023-07-21 10:14:03,631 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 10:14:03,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-21 10:14:03,934 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934443333.b666528e5ac6ac3b135d608e881f349d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:14:03,934 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing b666528e5ac6ac3b135d608e881f349d, disabling compactions & flushes 2023-07-21 10:14:03,934 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934443333.b666528e5ac6ac3b135d608e881f349d. 2023-07-21 10:14:03,934 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934443333.b666528e5ac6ac3b135d608e881f349d. 2023-07-21 10:14:03,934 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934443333.b666528e5ac6ac3b135d608e881f349d. after waiting 0 ms 2023-07-21 10:14:03,934 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934443333.b666528e5ac6ac3b135d608e881f349d. 2023-07-21 10:14:03,934 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934443333.b666528e5ac6ac3b135d608e881f349d. 2023-07-21 10:14:03,934 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for b666528e5ac6ac3b135d608e881f349d: 2023-07-21 10:14:03,938 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 10:14:03,939 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443333.69bf54c501efae9255d672d6c6955706.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689934443939"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934443939"}]},"ts":"1689934443939"} 2023-07-21 10:14:03,940 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934443333.b666528e5ac6ac3b135d608e881f349d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689934443939"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934443939"}]},"ts":"1689934443939"} 2023-07-21 10:14:03,956 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-21 10:14:03,958 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 10:14:03,958 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934443958"}]},"ts":"1689934443958"} 2023-07-21 10:14:03,960 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-21 10:14:03,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-21 10:14:03,962 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-21 10:14:03,964 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 10:14:03,964 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 10:14:03,964 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 10:14:03,964 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 10:14:03,964 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=69bf54c501efae9255d672d6c6955706, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b666528e5ac6ac3b135d608e881f349d, ASSIGN}] 2023-07-21 10:14:03,968 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=69bf54c501efae9255d672d6c6955706, ASSIGN 2023-07-21 10:14:03,968 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b666528e5ac6ac3b135d608e881f349d, ASSIGN 2023-07-21 10:14:03,976 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b666528e5ac6ac3b135d608e881f349d, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,37151,1689934329015; forceNewPlan=false, retain=false 2023-07-21 10:14:03,976 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=69bf54c501efae9255d672d6c6955706, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,36809,1689934328937; forceNewPlan=false, retain=false 2023-07-21 10:14:04,126 INFO [jenkins-hbase17:35385] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-21 10:14:04,130 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=b666528e5ac6ac3b135d608e881f349d, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:04,130 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=69bf54c501efae9255d672d6c6955706, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:04,130 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934443333.b666528e5ac6ac3b135d608e881f349d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689934444129"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934444129"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934444129"}]},"ts":"1689934444129"} 2023-07-21 10:14:04,130 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443333.69bf54c501efae9255d672d6c6955706.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689934444129"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934444129"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934444129"}]},"ts":"1689934444129"} 2023-07-21 10:14:04,133 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure b666528e5ac6ac3b135d608e881f349d, server=jenkins-hbase17.apache.org,37151,1689934329015}] 2023-07-21 10:14:04,136 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure 69bf54c501efae9255d672d6c6955706, server=jenkins-hbase17.apache.org,36809,1689934328937}] 2023-07-21 10:14:04,294 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443333.69bf54c501efae9255d672d6c6955706. 2023-07-21 10:14:04,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 69bf54c501efae9255d672d6c6955706, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443333.69bf54c501efae9255d672d6c6955706.', STARTKEY => '', ENDKEY => '2'} 2023-07-21 10:14:04,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443333.69bf54c501efae9255d672d6c6955706. service=AccessControlService 2023-07-21 10:14:04,295 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:14:04,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 69bf54c501efae9255d672d6c6955706 2023-07-21 10:14:04,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443333.69bf54c501efae9255d672d6c6955706.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:14:04,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 69bf54c501efae9255d672d6c6955706 2023-07-21 10:14:04,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 69bf54c501efae9255d672d6c6955706 2023-07-21 10:14:04,296 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934443333.b666528e5ac6ac3b135d608e881f349d. 2023-07-21 10:14:04,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b666528e5ac6ac3b135d608e881f349d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934443333.b666528e5ac6ac3b135d608e881f349d.', STARTKEY => '2', ENDKEY => ''} 2023-07-21 10:14:04,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934443333.b666528e5ac6ac3b135d608e881f349d. service=AccessControlService 2023-07-21 10:14:04,297 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:14:04,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 b666528e5ac6ac3b135d608e881f349d 2023-07-21 10:14:04,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934443333.b666528e5ac6ac3b135d608e881f349d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:14:04,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for b666528e5ac6ac3b135d608e881f349d 2023-07-21 10:14:04,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for b666528e5ac6ac3b135d608e881f349d 2023-07-21 10:14:04,300 INFO [StoreOpener-b666528e5ac6ac3b135d608e881f349d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b666528e5ac6ac3b135d608e881f349d 2023-07-21 10:14:04,301 INFO [StoreOpener-69bf54c501efae9255d672d6c6955706-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 69bf54c501efae9255d672d6c6955706 2023-07-21 10:14:04,307 DEBUG [StoreOpener-b666528e5ac6ac3b135d608e881f349d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b666528e5ac6ac3b135d608e881f349d/cf 2023-07-21 10:14:04,308 DEBUG [StoreOpener-b666528e5ac6ac3b135d608e881f349d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b666528e5ac6ac3b135d608e881f349d/cf 2023-07-21 10:14:04,309 INFO [StoreOpener-b666528e5ac6ac3b135d608e881f349d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b666528e5ac6ac3b135d608e881f349d columnFamilyName cf 2023-07-21 10:14:04,310 INFO [StoreOpener-b666528e5ac6ac3b135d608e881f349d-1] regionserver.HStore(310): Store=b666528e5ac6ac3b135d608e881f349d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:14:04,311 DEBUG [StoreOpener-69bf54c501efae9255d672d6c6955706-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69bf54c501efae9255d672d6c6955706/cf 2023-07-21 10:14:04,311 DEBUG [StoreOpener-69bf54c501efae9255d672d6c6955706-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69bf54c501efae9255d672d6c6955706/cf 2023-07-21 10:14:04,311 INFO [StoreOpener-69bf54c501efae9255d672d6c6955706-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 69bf54c501efae9255d672d6c6955706 columnFamilyName cf 2023-07-21 10:14:04,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b666528e5ac6ac3b135d608e881f349d 2023-07-21 10:14:04,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b666528e5ac6ac3b135d608e881f349d 2023-07-21 10:14:04,312 INFO [StoreOpener-69bf54c501efae9255d672d6c6955706-1] regionserver.HStore(310): Store=69bf54c501efae9255d672d6c6955706/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:14:04,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69bf54c501efae9255d672d6c6955706 2023-07-21 10:14:04,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69bf54c501efae9255d672d6c6955706 2023-07-21 10:14:04,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for b666528e5ac6ac3b135d608e881f349d 2023-07-21 10:14:04,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 69bf54c501efae9255d672d6c6955706 2023-07-21 10:14:04,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b666528e5ac6ac3b135d608e881f349d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 10:14:04,323 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened b666528e5ac6ac3b135d608e881f349d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75388219, jitterRate=0.12337200343608856}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 10:14:04,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for b666528e5ac6ac3b135d608e881f349d: 2023-07-21 10:14:04,326 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934443333.b666528e5ac6ac3b135d608e881f349d., pid=69, masterSystemTime=1689934444289 2023-07-21 10:14:04,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69bf54c501efae9255d672d6c6955706/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 10:14:04,334 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 69bf54c501efae9255d672d6c6955706; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74308354, jitterRate=0.10728076100349426}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 10:14:04,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 69bf54c501efae9255d672d6c6955706: 2023-07-21 10:14:04,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934443333.b666528e5ac6ac3b135d608e881f349d. 2023-07-21 10:14:04,337 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934443333.b666528e5ac6ac3b135d608e881f349d. 2023-07-21 10:14:04,338 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=b666528e5ac6ac3b135d608e881f349d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:04,338 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934443333.b666528e5ac6ac3b135d608e881f349d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689934444337"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689934444337"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689934444337"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689934444337"}]},"ts":"1689934444337"} 2023-07-21 10:14:04,338 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443333.69bf54c501efae9255d672d6c6955706., pid=70, masterSystemTime=1689934444289 2023-07-21 10:14:04,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443333.69bf54c501efae9255d672d6c6955706. 2023-07-21 10:14:04,343 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443333.69bf54c501efae9255d672d6c6955706. 2023-07-21 10:14:04,343 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-21 10:14:04,344 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure b666528e5ac6ac3b135d608e881f349d, server=jenkins-hbase17.apache.org,37151,1689934329015 in 207 msec 2023-07-21 10:14:04,344 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=69bf54c501efae9255d672d6c6955706, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:04,344 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443333.69bf54c501efae9255d672d6c6955706.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689934444343"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689934444343"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689934444343"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689934444343"}]},"ts":"1689934444343"} 2023-07-21 10:14:04,349 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b666528e5ac6ac3b135d608e881f349d, ASSIGN in 380 msec 2023-07-21 10:14:04,355 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-21 10:14:04,355 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure 69bf54c501efae9255d672d6c6955706, server=jenkins-hbase17.apache.org,36809,1689934328937 in 214 msec 2023-07-21 10:14:04,358 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-21 10:14:04,358 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=69bf54c501efae9255d672d6c6955706, ASSIGN in 391 msec 2023-07-21 10:14:04,359 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 10:14:04,359 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934444359"}]},"ts":"1689934444359"} 2023-07-21 10:14:04,361 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-21 10:14:04,363 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 10:14:04,364 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-21 10:14:04,370 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37151] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-21 10:14:04,372 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:04,372 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:04,372 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:04,372 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:04,375 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 10:14:04,382 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 10:14:04,382 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 10:14:04,382 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-21 10:14:04,382 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-21 10:14:04,384 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:04,385 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 10:14:04,385 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-21 10:14:04,385 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-21 10:14:04,393 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 1.0560 sec 2023-07-21 10:14:04,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-21 10:14:04,464 INFO [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-21 10:14:04,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.HMaster$2(1952): Client=jenkins//136.243.18.41 merge regions 69bf54c501efae9255d672d6c6955706, b666528e5ac6ac3b135d608e881f349d 2023-07-21 10:14:04,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[69bf54c501efae9255d672d6c6955706, b666528e5ac6ac3b135d608e881f349d], force=true 2023-07-21 10:14:04,552 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[69bf54c501efae9255d672d6c6955706, b666528e5ac6ac3b135d608e881f349d], force=true 2023-07-21 10:14:04,553 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[69bf54c501efae9255d672d6c6955706, b666528e5ac6ac3b135d608e881f349d], force=true 2023-07-21 10:14:04,553 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[69bf54c501efae9255d672d6c6955706, b666528e5ac6ac3b135d608e881f349d], force=true 2023-07-21 10:14:04,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-21 10:14:04,589 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=69bf54c501efae9255d672d6c6955706, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b666528e5ac6ac3b135d608e881f349d, UNASSIGN}] 2023-07-21 10:14:04,593 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b666528e5ac6ac3b135d608e881f349d, UNASSIGN 2023-07-21 10:14:04,593 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=69bf54c501efae9255d672d6c6955706, UNASSIGN 2023-07-21 10:14:04,596 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=b666528e5ac6ac3b135d608e881f349d, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:04,596 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=69bf54c501efae9255d672d6c6955706, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:04,596 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934443333.b666528e5ac6ac3b135d608e881f349d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689934444596"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934444596"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934444596"}]},"ts":"1689934444596"} 2023-07-21 10:14:04,596 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443333.69bf54c501efae9255d672d6c6955706.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689934444596"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934444596"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934444596"}]},"ts":"1689934444596"} 2023-07-21 10:14:04,609 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 69bf54c501efae9255d672d6c6955706, server=jenkins-hbase17.apache.org,36809,1689934328937}] 2023-07-21 10:14:04,610 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure b666528e5ac6ac3b135d608e881f349d, server=jenkins-hbase17.apache.org,37151,1689934329015}] 2023-07-21 10:14:04,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-21 10:14:04,762 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 69bf54c501efae9255d672d6c6955706 2023-07-21 10:14:04,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 69bf54c501efae9255d672d6c6955706, disabling compactions & flushes 2023-07-21 10:14:04,764 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443333.69bf54c501efae9255d672d6c6955706. 2023-07-21 10:14:04,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443333.69bf54c501efae9255d672d6c6955706. 2023-07-21 10:14:04,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443333.69bf54c501efae9255d672d6c6955706. after waiting 0 ms 2023-07-21 10:14:04,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443333.69bf54c501efae9255d672d6c6955706. 2023-07-21 10:14:04,765 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 69bf54c501efae9255d672d6c6955706 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-21 10:14:04,765 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close b666528e5ac6ac3b135d608e881f349d 2023-07-21 10:14:04,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing b666528e5ac6ac3b135d608e881f349d, disabling compactions & flushes 2023-07-21 10:14:04,770 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934443333.b666528e5ac6ac3b135d608e881f349d. 2023-07-21 10:14:04,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934443333.b666528e5ac6ac3b135d608e881f349d. 2023-07-21 10:14:04,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934443333.b666528e5ac6ac3b135d608e881f349d. after waiting 0 ms 2023-07-21 10:14:04,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934443333.b666528e5ac6ac3b135d608e881f349d. 2023-07-21 10:14:04,770 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing b666528e5ac6ac3b135d608e881f349d 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-21 10:14:04,812 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69bf54c501efae9255d672d6c6955706/.tmp/cf/abc4aa694c714ed89fbde221e12d038a 2023-07-21 10:14:04,827 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b666528e5ac6ac3b135d608e881f349d/.tmp/cf/725ca77040074875963115c0c13e9372 2023-07-21 10:14:04,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b666528e5ac6ac3b135d608e881f349d/.tmp/cf/725ca77040074875963115c0c13e9372 as hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b666528e5ac6ac3b135d608e881f349d/cf/725ca77040074875963115c0c13e9372 2023-07-21 10:14:04,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69bf54c501efae9255d672d6c6955706/.tmp/cf/abc4aa694c714ed89fbde221e12d038a as hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69bf54c501efae9255d672d6c6955706/cf/abc4aa694c714ed89fbde221e12d038a 2023-07-21 10:14:04,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-21 10:14:04,866 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b666528e5ac6ac3b135d608e881f349d/cf/725ca77040074875963115c0c13e9372, entries=1, sequenceid=5, filesize=4.7 K 2023-07-21 10:14:04,867 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for b666528e5ac6ac3b135d608e881f349d in 97ms, sequenceid=5, compaction requested=false 2023-07-21 10:14:04,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-21 10:14:04,869 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69bf54c501efae9255d672d6c6955706/cf/abc4aa694c714ed89fbde221e12d038a, entries=1, sequenceid=5, filesize=4.7 K 2023-07-21 10:14:04,883 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 69bf54c501efae9255d672d6c6955706 in 118ms, sequenceid=5, compaction requested=false 2023-07-21 10:14:04,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69bf54c501efae9255d672d6c6955706/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-21 10:14:04,917 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b666528e5ac6ac3b135d608e881f349d/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-21 10:14:04,917 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:14:04,917 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443333.69bf54c501efae9255d672d6c6955706. 2023-07-21 10:14:04,917 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 69bf54c501efae9255d672d6c6955706: 2023-07-21 10:14:04,917 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:14:04,917 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934443333.b666528e5ac6ac3b135d608e881f349d. 2023-07-21 10:14:04,917 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for b666528e5ac6ac3b135d608e881f349d: 2023-07-21 10:14:04,918 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 69bf54c501efae9255d672d6c6955706 2023-07-21 10:14:04,919 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=69bf54c501efae9255d672d6c6955706, regionState=CLOSED 2023-07-21 10:14:04,919 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443333.69bf54c501efae9255d672d6c6955706.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689934444919"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934444919"}]},"ts":"1689934444919"} 2023-07-21 10:14:04,919 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed b666528e5ac6ac3b135d608e881f349d 2023-07-21 10:14:04,919 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=b666528e5ac6ac3b135d608e881f349d, regionState=CLOSED 2023-07-21 10:14:04,919 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934443333.b666528e5ac6ac3b135d608e881f349d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689934444919"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934444919"}]},"ts":"1689934444919"} 2023-07-21 10:14:04,922 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-21 10:14:04,922 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 69bf54c501efae9255d672d6c6955706, server=jenkins-hbase17.apache.org,36809,1689934328937 in 312 msec 2023-07-21 10:14:04,923 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-21 10:14:04,923 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure b666528e5ac6ac3b135d608e881f349d, server=jenkins-hbase17.apache.org,37151,1689934329015 in 311 msec 2023-07-21 10:14:04,929 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=69bf54c501efae9255d672d6c6955706, UNASSIGN in 338 msec 2023-07-21 10:14:04,929 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-21 10:14:04,929 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b666528e5ac6ac3b135d608e881f349d, UNASSIGN in 334 msec 2023-07-21 10:14:05,069 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57d9f1bee8f64bf9bc924828cf413c17/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-21 10:14:05,079 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443333.69bf54c501efae9255d672d6c6955706.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-21 10:14:05,079 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934443333.b666528e5ac6ac3b135d608e881f349d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-21 10:14:05,079 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443334.57d9f1bee8f64bf9bc924828cf413c17.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-21 10:14:05,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-21 10:14:05,172 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=57d9f1bee8f64bf9bc924828cf413c17, ASSIGN}] 2023-07-21 10:14:05,176 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=57d9f1bee8f64bf9bc924828cf413c17, ASSIGN 2023-07-21 10:14:05,178 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=57d9f1bee8f64bf9bc924828cf413c17, ASSIGN; state=MERGED, location=jenkins-hbase17.apache.org,36809,1689934328937; forceNewPlan=false, retain=false 2023-07-21 10:14:05,328 INFO [jenkins-hbase17:35385] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-21 10:14:05,330 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=57d9f1bee8f64bf9bc924828cf413c17, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:05,330 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443334.57d9f1bee8f64bf9bc924828cf413c17.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689934445330"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934445330"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934445330"}]},"ts":"1689934445330"} 2023-07-21 10:14:05,334 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 57d9f1bee8f64bf9bc924828cf413c17, server=jenkins-hbase17.apache.org,36809,1689934328937}] 2023-07-21 10:14:05,509 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443334.57d9f1bee8f64bf9bc924828cf413c17. 2023-07-21 10:14:05,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 57d9f1bee8f64bf9bc924828cf413c17, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443334.57d9f1bee8f64bf9bc924828cf413c17.', STARTKEY => '', ENDKEY => ''} 2023-07-21 10:14:05,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443334.57d9f1bee8f64bf9bc924828cf413c17. service=AccessControlService 2023-07-21 10:14:05,509 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:14:05,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 57d9f1bee8f64bf9bc924828cf413c17 2023-07-21 10:14:05,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443334.57d9f1bee8f64bf9bc924828cf413c17.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:14:05,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 57d9f1bee8f64bf9bc924828cf413c17 2023-07-21 10:14:05,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 57d9f1bee8f64bf9bc924828cf413c17 2023-07-21 10:14:05,514 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57d9f1bee8f64bf9bc924828cf413c17/.regioninfo 2023-07-21 10:14:05,597 INFO [StoreOpener-57d9f1bee8f64bf9bc924828cf413c17-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 57d9f1bee8f64bf9bc924828cf413c17 2023-07-21 10:14:05,599 DEBUG [StoreOpener-57d9f1bee8f64bf9bc924828cf413c17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57d9f1bee8f64bf9bc924828cf413c17/cf 2023-07-21 10:14:05,599 DEBUG [StoreOpener-57d9f1bee8f64bf9bc924828cf413c17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57d9f1bee8f64bf9bc924828cf413c17/cf 2023-07-21 10:14:05,600 INFO [StoreOpener-57d9f1bee8f64bf9bc924828cf413c17-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 57d9f1bee8f64bf9bc924828cf413c17 columnFamilyName cf 2023-07-21 10:14:05,663 DEBUG [StoreOpener-57d9f1bee8f64bf9bc924828cf413c17-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57d9f1bee8f64bf9bc924828cf413c17/cf/725ca77040074875963115c0c13e9372.b666528e5ac6ac3b135d608e881f349d->hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b666528e5ac6ac3b135d608e881f349d/cf/725ca77040074875963115c0c13e9372-top 2023-07-21 10:14:05,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-21 10:14:05,677 DEBUG [StoreOpener-57d9f1bee8f64bf9bc924828cf413c17-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57d9f1bee8f64bf9bc924828cf413c17/cf/abc4aa694c714ed89fbde221e12d038a.69bf54c501efae9255d672d6c6955706->hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69bf54c501efae9255d672d6c6955706/cf/abc4aa694c714ed89fbde221e12d038a-top 2023-07-21 10:14:05,678 INFO [StoreOpener-57d9f1bee8f64bf9bc924828cf413c17-1] regionserver.HStore(310): Store=57d9f1bee8f64bf9bc924828cf413c17/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:14:05,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57d9f1bee8f64bf9bc924828cf413c17 2023-07-21 10:14:05,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57d9f1bee8f64bf9bc924828cf413c17 2023-07-21 10:14:05,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 57d9f1bee8f64bf9bc924828cf413c17 2023-07-21 10:14:05,688 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 57d9f1bee8f64bf9bc924828cf413c17; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68036273, jitterRate=0.013819471001625061}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 10:14:05,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 57d9f1bee8f64bf9bc924828cf413c17: 2023-07-21 10:14:05,699 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443334.57d9f1bee8f64bf9bc924828cf413c17., pid=77, masterSystemTime=1689934445488 2023-07-21 10:14:05,700 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443334.57d9f1bee8f64bf9bc924828cf413c17.,because compaction is disabled. 2023-07-21 10:14:05,704 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=57d9f1bee8f64bf9bc924828cf413c17, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:05,704 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443334.57d9f1bee8f64bf9bc924828cf413c17.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689934445704"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689934445704"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689934445704"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689934445704"}]},"ts":"1689934445704"} 2023-07-21 10:14:05,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443334.57d9f1bee8f64bf9bc924828cf413c17. 2023-07-21 10:14:05,705 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443334.57d9f1bee8f64bf9bc924828cf413c17. 2023-07-21 10:14:05,711 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-21 10:14:05,711 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 57d9f1bee8f64bf9bc924828cf413c17, server=jenkins-hbase17.apache.org,36809,1689934328937 in 373 msec 2023-07-21 10:14:05,713 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-21 10:14:05,713 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=57d9f1bee8f64bf9bc924828cf413c17, ASSIGN in 539 msec 2023-07-21 10:14:05,716 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[69bf54c501efae9255d672d6c6955706, b666528e5ac6ac3b135d608e881f349d], force=true in 1.1710 sec 2023-07-21 10:14:06,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-21 10:14:06,668 INFO [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-21 10:14:06,669 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-21 10:14:06,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689934446669 (current time:1689934446669). 2023-07-21 10:14:06,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 10:14:06,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] zookeeper.ReadOnlyZKClient(139): Connect 0x32ceec8b to 127.0.0.1:56971 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:14:06,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62485950, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:14:06,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:14:06,700 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:52516, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:14:06,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x32ceec8b to 127.0.0.1:56971 2023-07-21 10:14:06,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:14:06,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] zookeeper.ReadOnlyZKClient(139): Connect 0x66ddc245 to 127.0.0.1:56971 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:14:06,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@23b2d0a1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:14:06,734 DEBUG [hconnection-0x3909f5e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:14:06,747 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:52522, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:14:06,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:14:06,760 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:47428, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:14:06,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66ddc245 to 127.0.0.1:56971 2023-07-21 10:14:06,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:14:06,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-21 10:14:06,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 10:14:06,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-21 10:14:06,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-21 10:14:06,768 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-21 10:14:06,773 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689935046773 2023-07-21 10:14:06,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-21 10:14:06,773 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,777 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 10:14:06,778 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 10:14:06,789 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-21 10:14:06,791 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-21 10:14:06,804 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 26 msec 2023-07-21 10:14:06,806 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-21 10:14:06,811 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689935046811 2023-07-21 10:14:06,841 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,841 INFO [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-21 10:14:06,841 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:14:06,846 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-21 10:14:06,847 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-21 10:14:06,848 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,848 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,857 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:06,858 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:06,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:06,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:06,857 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:06,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:06,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:06,857 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:06,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:06,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:06,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,858 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:06,859 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 10:14:06,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,859 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,859 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-21 10:14:06,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-21 10:14:06,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,860 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-21 10:14:06,860 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-21 10:14:06,860 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-21 10:14:06,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,861 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-21 10:14:06,864 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,864 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-21 10:14:06,864 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:14:06,866 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,866 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-21 10:14:06,866 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:14:06,880 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,878 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:14:06,868 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-21 10:14:06,882 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-21 10:14:06,882 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,37151,1689934329015' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-21 10:14:06,882 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-21 10:14:06,883 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:14:06,882 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-21 10:14:06,885 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-21 10:14:06,885 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-21 10:14:06,885 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-21 10:14:06,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-21 10:14:06,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:14:06,886 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 10:14:06,886 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,38751,1689934329069' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-21 10:14:06,885 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36809,1689934328937' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-21 10:14:06,887 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,887 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,887 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:14:06,888 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,888 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,888 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,888 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:14:06,888 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,888 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:14:06,889 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:06,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:06,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:06,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:06,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:06,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:06,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:06,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:06,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:06,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:06,893 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,36809,1689934328937' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-21 10:14:06,893 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4fe9c25[Count = 0] remaining members to acquire global barrier 2023-07-21 10:14:06,893 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-21 10:14:06,893 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,895 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,895 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,895 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,895 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-21 10:14:06,895 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:06,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,895 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 10:14:06,895 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-21 10:14:06,895 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-21 10:14:06,896 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-21 10:14:06,896 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:14:06,896 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:14:06,896 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase17.apache.org,38751,1689934329069' in zk 2023-07-21 10:14:06,897 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-21 10:14:06,897 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:14:06,897 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-21 10:14:06,896 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443334.57d9f1bee8f64bf9bc924828cf413c17. 2023-07-21 10:14:06,896 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-21 10:14:06,902 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase17.apache.org,37151,1689934329015' in zk 2023-07-21 10:14:06,902 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443334.57d9f1bee8f64bf9bc924828cf413c17. started... 2023-07-21 10:14:06,905 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 57d9f1bee8f64bf9bc924828cf413c17: 2023-07-21 10:14:06,905 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443334.57d9f1bee8f64bf9bc924828cf413c17.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,905 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:14:06,905 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57d9f1bee8f64bf9bc924828cf413c17/cf/725ca77040074875963115c0c13e9372.b666528e5ac6ac3b135d608e881f349d->hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b666528e5ac6ac3b135d608e881f349d/cf/725ca77040074875963115c0c13e9372-top, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57d9f1bee8f64bf9bc924828cf413c17/cf/abc4aa694c714ed89fbde221e12d038a.69bf54c501efae9255d672d6c6955706->hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69bf54c501efae9255d672d6c6955706/cf/abc4aa694c714ed89fbde221e12d038a-top] hfiles 2023-07-21 10:14:06,905 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57d9f1bee8f64bf9bc924828cf413c17/cf/725ca77040074875963115c0c13e9372.b666528e5ac6ac3b135d608e881f349d for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,908 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-21 10:14:06,908 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:14:06,908 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-21 10:14:06,930 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57d9f1bee8f64bf9bc924828cf413c17/cf/abc4aa694c714ed89fbde221e12d038a.69bf54c501efae9255d672d6c6955706 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,980 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443334.57d9f1bee8f64bf9bc924828cf413c17. completed. 2023-07-21 10:14:06,980 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443334.57d9f1bee8f64bf9bc924828cf413c17. 2023-07-21 10:14:06,981 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:14:06,981 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:14:06,981 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:06,981 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-21 10:14:06,981 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase17.apache.org,36809,1689934328937' in zk 2023-07-21 10:14:06,983 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-21 10:14:06,983 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:06,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:06,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:06,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:06,984 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:14:06,984 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-21 10:14:06,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:06,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:06,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:06,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:06,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:06,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:06,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:06,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:06,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:06,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase17.apache.org,36809,1689934328937': 2023-07-21 10:14:06,993 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,36809,1689934328937' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-21 10:14:06,993 INFO [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-21 10:14:06,994 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 10:14:06,994 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 10:14:06,994 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,994 INFO [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 10:14:06,997 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,997 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:06,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,997 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,997 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:06,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,998 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,998 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:06,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:06,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:06,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:06,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:06,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:06,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:06,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:06,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:07,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:07,000 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:07,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:07,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:07,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:07,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:07,002 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:07,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:07,003 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:07,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:07,003 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:07,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:07,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:07,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:07,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:07,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:07,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:07,007 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:07,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:07,007 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:07,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:07,008 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:07,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:07,022 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:07,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:07,022 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:07,022 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:07,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:07,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:07,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:07,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:07,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:07,022 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:07,022 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:07,023 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:07,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:07,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:07,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:07,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:07,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:07,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:07,028 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:14:07,028 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:07,028 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:07,031 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:07,031 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:07,031 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:07,031 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:07,031 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:07,031 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:07,031 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:07,031 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:07,031 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:07,031 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:07,032 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:07,032 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:07,086 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:14:07,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-21 10:14:07,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:14:07,089 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 10:14:07,180 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:07,229 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-21 10:14:07,229 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:07,229 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:07,229 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689934446773Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689934447028 (+255 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689934447029 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689934447053 (+24 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689934447169 (+116 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689934447229 (+60 ms) 2023-07-21 10:14:07,232 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-21 10:14:07,234 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 455 msec 2023-07-21 10:14:07,389 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:14:07,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-21 10:14:07,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 10:14:07,390 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934447390 2023-07-21 10:14:07,391 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost.localdomain:35937, tgtDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934447390, rawTgtDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934447390, srcFsUri=hdfs://localhost.localdomain:35937, srcDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f 2023-07-21 10:14:07,423 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:35937, inputRoot=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f 2023-07-21 10:14:07,423 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_31123585_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934447390, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934447390/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:07,423 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:35937, inputRoot=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f, snapshotDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-21 10:14:07,435 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934447390/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:07,937 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:07,937 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:07,938 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:07,938 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:07,938 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:07,939 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:07,939 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:08,022 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/hadoop-6421253755275635099.jar 2023-07-21 10:14:08,022 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:08,023 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:08,023 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:08,023 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:08,024 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:08,024 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:08,025 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-21 10:14:08,025 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-21 10:14:08,026 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-21 10:14:08,026 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-21 10:14:08,027 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-21 10:14:08,027 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-21 10:14:08,028 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-21 10:14:08,028 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-21 10:14:08,028 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-21 10:14:08,029 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-21 10:14:08,030 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:14:08,030 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:14:08,030 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 10:14:08,031 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:14:08,031 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:14:08,032 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 10:14:08,032 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 10:14:09,798 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 10:14:11,190 WARN [Listener at jenkins-hbase17.apache.org/42227] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-21 10:14:11,213 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-21 10:14:11,216 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-21 10:14:12,368 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 10:14:12,368 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 10:14:13,269 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934340509_0005_000001 (auth:SIMPLE) 2023-07-21 10:14:26,494 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934340509_0005_000001 (auth:SIMPLE) 2023-07-21 10:14:29,437 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934340509_0005_000001 (auth:SIMPLE) 2023-07-21 10:14:37,461 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-21 10:14:37,463 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-21 10:14:37,549 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:37,549 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-21 10:14:37,553 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-21 10:14:37,553 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1557406679_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:37,556 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-21 10:14:37,557 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-21 10:14:37,557 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1557406679_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934447390/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934447390/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:37,560 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934447390/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-21 10:14:37,561 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934447390/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-21 10:14:37,617 INFO [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:37,621 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:37,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:37,645 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934477645"}]},"ts":"1689934477645"} 2023-07-21 10:14:37,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-21 10:14:37,660 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-21 10:14:37,662 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-21 10:14:37,666 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=57d9f1bee8f64bf9bc924828cf413c17, UNASSIGN}] 2023-07-21 10:14:37,670 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=57d9f1bee8f64bf9bc924828cf413c17, UNASSIGN 2023-07-21 10:14:37,673 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=57d9f1bee8f64bf9bc924828cf413c17, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:37,674 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443334.57d9f1bee8f64bf9bc924828cf413c17.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689934477673"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934477673"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934477673"}]},"ts":"1689934477673"} 2023-07-21 10:14:37,692 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 57d9f1bee8f64bf9bc924828cf413c17, server=jenkins-hbase17.apache.org,36809,1689934328937}] 2023-07-21 10:14:37,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-21 10:14:37,856 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 57d9f1bee8f64bf9bc924828cf413c17 2023-07-21 10:14:37,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 57d9f1bee8f64bf9bc924828cf413c17, disabling compactions & flushes 2023-07-21 10:14:37,857 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443334.57d9f1bee8f64bf9bc924828cf413c17. 2023-07-21 10:14:37,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443334.57d9f1bee8f64bf9bc924828cf413c17. 2023-07-21 10:14:37,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443334.57d9f1bee8f64bf9bc924828cf413c17. after waiting 0 ms 2023-07-21 10:14:37,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443334.57d9f1bee8f64bf9bc924828cf413c17. 2023-07-21 10:14:37,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57d9f1bee8f64bf9bc924828cf413c17/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-21 10:14:37,936 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:14:37,942 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443334.57d9f1bee8f64bf9bc924828cf413c17. 2023-07-21 10:14:37,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 57d9f1bee8f64bf9bc924828cf413c17: 2023-07-21 10:14:37,945 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 57d9f1bee8f64bf9bc924828cf413c17 2023-07-21 10:14:37,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-21 10:14:37,953 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=57d9f1bee8f64bf9bc924828cf413c17, regionState=CLOSED 2023-07-21 10:14:37,954 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443334.57d9f1bee8f64bf9bc924828cf413c17.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689934477953"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934477953"}]},"ts":"1689934477953"} 2023-07-21 10:14:38,021 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-21 10:14:38,021 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 57d9f1bee8f64bf9bc924828cf413c17, server=jenkins-hbase17.apache.org,36809,1689934328937 in 280 msec 2023-07-21 10:14:38,024 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-21 10:14:38,024 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=57d9f1bee8f64bf9bc924828cf413c17, UNASSIGN in 355 msec 2023-07-21 10:14:38,028 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934478028"}]},"ts":"1689934478028"} 2023-07-21 10:14:38,031 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-21 10:14:38,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-21 10:14:38,420 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-21 10:14:38,437 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 809 msec 2023-07-21 10:14:38,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-21 10:14:38,759 INFO [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-21 10:14:38,766 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:38,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:38,771 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:38,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:38,772 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:38,773 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37151] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:38,800 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57d9f1bee8f64bf9bc924828cf413c17 2023-07-21 10:14:38,809 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69bf54c501efae9255d672d6c6955706 2023-07-21 10:14:38,813 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57d9f1bee8f64bf9bc924828cf413c17/cf, FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57d9f1bee8f64bf9bc924828cf413c17/recovered.edits] 2023-07-21 10:14:38,817 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b666528e5ac6ac3b135d608e881f349d 2023-07-21 10:14:38,826 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b666528e5ac6ac3b135d608e881f349d/cf, FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b666528e5ac6ac3b135d608e881f349d/recovered.edits] 2023-07-21 10:14:38,832 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b666528e5ac6ac3b135d608e881f349d/cf/725ca77040074875963115c0c13e9372 to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b666528e5ac6ac3b135d608e881f349d/cf/725ca77040074875963115c0c13e9372 2023-07-21 10:14:38,840 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b666528e5ac6ac3b135d608e881f349d/recovered.edits/8.seqid to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b666528e5ac6ac3b135d608e881f349d/recovered.edits/8.seqid 2023-07-21 10:14:38,841 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b666528e5ac6ac3b135d608e881f349d 2023-07-21 10:14:38,842 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57d9f1bee8f64bf9bc924828cf413c17/cf/725ca77040074875963115c0c13e9372.b666528e5ac6ac3b135d608e881f349d to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57d9f1bee8f64bf9bc924828cf413c17/cf/725ca77040074875963115c0c13e9372.b666528e5ac6ac3b135d608e881f349d 2023-07-21 10:14:38,842 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69bf54c501efae9255d672d6c6955706/cf, FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69bf54c501efae9255d672d6c6955706/recovered.edits] 2023-07-21 10:14:38,844 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57d9f1bee8f64bf9bc924828cf413c17/cf/abc4aa694c714ed89fbde221e12d038a.69bf54c501efae9255d672d6c6955706 to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57d9f1bee8f64bf9bc924828cf413c17/cf/abc4aa694c714ed89fbde221e12d038a.69bf54c501efae9255d672d6c6955706 2023-07-21 10:14:38,849 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57d9f1bee8f64bf9bc924828cf413c17/recovered.edits/12.seqid to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57d9f1bee8f64bf9bc924828cf413c17/recovered.edits/12.seqid 2023-07-21 10:14:38,850 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/57d9f1bee8f64bf9bc924828cf413c17 2023-07-21 10:14:38,851 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69bf54c501efae9255d672d6c6955706/cf/abc4aa694c714ed89fbde221e12d038a to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69bf54c501efae9255d672d6c6955706/cf/abc4aa694c714ed89fbde221e12d038a 2023-07-21 10:14:38,855 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69bf54c501efae9255d672d6c6955706/recovered.edits/8.seqid to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69bf54c501efae9255d672d6c6955706/recovered.edits/8.seqid 2023-07-21 10:14:38,855 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/69bf54c501efae9255d672d6c6955706 2023-07-21 10:14:38,855 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-21 10:14:38,864 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:38,904 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-21 10:14:38,921 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-21 10:14:38,929 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:38,929 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-21 10:14:38,929 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443334.57d9f1bee8f64bf9bc924828cf413c17.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689934478929"}]},"ts":"9223372036854775807"} 2023-07-21 10:14:38,953 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-21 10:14:38,953 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 57d9f1bee8f64bf9bc924828cf413c17, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689934443334.57d9f1bee8f64bf9bc924828cf413c17.', STARTKEY => '', ENDKEY => ''}] 2023-07-21 10:14:38,953 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-21 10:14:38,954 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689934478953"}]},"ts":"9223372036854775807"} 2023-07-21 10:14:38,985 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-21 10:14:39,384 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:39,384 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:39,384 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:39,384 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:39,537 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-21 10:14:39,537 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:39,537 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-21 10:14:39,538 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-21 10:14:39,538 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-21 10:14:39,538 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-21 10:14:39,538 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-21 10:14:39,538 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-21 10:14:39,539 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:39,539 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:39,539 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:39,539 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:39,541 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:39,542 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 10:14:39,542 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 10:14:39,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-21 10:14:39,543 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 10:14:39,544 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 10:14:39,544 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 775 msec 2023-07-21 10:14:39,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-21 10:14:39,645 INFO [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-21 10:14:39,647 INFO [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:39,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:39,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:39,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-21 10:14:39,657 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934479657"}]},"ts":"1689934479657"} 2023-07-21 10:14:39,659 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-21 10:14:39,661 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-21 10:14:39,663 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=dfb877ee2acda63388da237538597f0b, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=86c0cdabf731340ea1b965371f5387ef, UNASSIGN}] 2023-07-21 10:14:39,667 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=dfb877ee2acda63388da237538597f0b, UNASSIGN 2023-07-21 10:14:39,669 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=dfb877ee2acda63388da237538597f0b, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:39,670 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689934439099.dfb877ee2acda63388da237538597f0b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689934479669"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934479669"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934479669"}]},"ts":"1689934479669"} 2023-07-21 10:14:39,673 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=86c0cdabf731340ea1b965371f5387ef, UNASSIGN 2023-07-21 10:14:39,676 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=86c0cdabf731340ea1b965371f5387ef, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:39,676 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689934439099.86c0cdabf731340ea1b965371f5387ef.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689934479676"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934479676"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934479676"}]},"ts":"1689934479676"} 2023-07-21 10:14:39,679 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure dfb877ee2acda63388da237538597f0b, server=jenkins-hbase17.apache.org,36809,1689934328937}] 2023-07-21 10:14:39,681 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 86c0cdabf731340ea1b965371f5387ef, server=jenkins-hbase17.apache.org,37151,1689934329015}] 2023-07-21 10:14:39,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-21 10:14:39,838 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 86c0cdabf731340ea1b965371f5387ef 2023-07-21 10:14:39,838 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 86c0cdabf731340ea1b965371f5387ef, disabling compactions & flushes 2023-07-21 10:14:39,838 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689934439099.86c0cdabf731340ea1b965371f5387ef. 2023-07-21 10:14:39,838 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689934439099.86c0cdabf731340ea1b965371f5387ef. 2023-07-21 10:14:39,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689934439099.86c0cdabf731340ea1b965371f5387ef. after waiting 0 ms 2023-07-21 10:14:39,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689934439099.86c0cdabf731340ea1b965371f5387ef. 2023-07-21 10:14:39,844 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close dfb877ee2acda63388da237538597f0b 2023-07-21 10:14:39,845 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing dfb877ee2acda63388da237538597f0b, disabling compactions & flushes 2023-07-21 10:14:39,845 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689934439099.dfb877ee2acda63388da237538597f0b. 2023-07-21 10:14:39,845 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689934439099.dfb877ee2acda63388da237538597f0b. 2023-07-21 10:14:39,845 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689934439099.dfb877ee2acda63388da237538597f0b. after waiting 0 ms 2023-07-21 10:14:39,845 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689934439099.dfb877ee2acda63388da237538597f0b. 2023-07-21 10:14:39,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion/dfb877ee2acda63388da237538597f0b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 10:14:39,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:14:39,927 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689934439099.dfb877ee2acda63388da237538597f0b. 2023-07-21 10:14:39,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for dfb877ee2acda63388da237538597f0b: 2023-07-21 10:14:39,935 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed dfb877ee2acda63388da237538597f0b 2023-07-21 10:14:39,938 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=dfb877ee2acda63388da237538597f0b, regionState=CLOSED 2023-07-21 10:14:39,939 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689934439099.dfb877ee2acda63388da237538597f0b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689934479938"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934479938"}]},"ts":"1689934479938"} 2023-07-21 10:14:39,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithMergeRegion/86c0cdabf731340ea1b965371f5387ef/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 10:14:39,950 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-21 10:14:39,950 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure dfb877ee2acda63388da237538597f0b, server=jenkins-hbase17.apache.org,36809,1689934328937 in 266 msec 2023-07-21 10:14:39,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:14:39,953 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=dfb877ee2acda63388da237538597f0b, UNASSIGN in 287 msec 2023-07-21 10:14:39,958 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689934439099.86c0cdabf731340ea1b965371f5387ef. 2023-07-21 10:14:39,959 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 86c0cdabf731340ea1b965371f5387ef: 2023-07-21 10:14:39,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-21 10:14:39,975 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 86c0cdabf731340ea1b965371f5387ef 2023-07-21 10:14:39,975 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=86c0cdabf731340ea1b965371f5387ef, regionState=CLOSED 2023-07-21 10:14:39,975 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689934439099.86c0cdabf731340ea1b965371f5387ef.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689934479975"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934479975"}]},"ts":"1689934479975"} 2023-07-21 10:14:39,988 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-21 10:14:39,989 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 86c0cdabf731340ea1b965371f5387ef, server=jenkins-hbase17.apache.org,37151,1689934329015 in 304 msec 2023-07-21 10:14:39,992 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-21 10:14:39,992 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=86c0cdabf731340ea1b965371f5387ef, UNASSIGN in 326 msec 2023-07-21 10:14:39,995 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934479995"}]},"ts":"1689934479995"} 2023-07-21 10:14:39,996 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-21 10:14:39,998 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-21 10:14:40,001 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 351 msec 2023-07-21 10:14:40,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-21 10:14:40,271 INFO [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-21 10:14:40,273 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:40,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:40,289 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:40,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:40,293 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37151] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:40,296 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:40,297 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:40,297 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:40,298 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-21 10:14:40,300 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:40,300 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-21 10:14:40,301 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-21 10:14:40,301 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-21 10:14:40,301 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:40,309 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:40,309 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:40,309 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:40,309 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:40,310 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:40,310 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:40,310 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:40,310 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:40,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-21 10:14:40,340 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dfb877ee2acda63388da237538597f0b 2023-07-21 10:14:40,341 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/86c0cdabf731340ea1b965371f5387ef 2023-07-21 10:14:40,364 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dfb877ee2acda63388da237538597f0b/cf, FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dfb877ee2acda63388da237538597f0b/recovered.edits] 2023-07-21 10:14:40,364 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/86c0cdabf731340ea1b965371f5387ef/cf, FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/86c0cdabf731340ea1b965371f5387ef/recovered.edits] 2023-07-21 10:14:40,379 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/86c0cdabf731340ea1b965371f5387ef/cf/0adcd5a097a944de8545b3f399efa92d to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/86c0cdabf731340ea1b965371f5387ef/cf/0adcd5a097a944de8545b3f399efa92d 2023-07-21 10:14:40,390 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/86c0cdabf731340ea1b965371f5387ef/recovered.edits/9.seqid to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/86c0cdabf731340ea1b965371f5387ef/recovered.edits/9.seqid 2023-07-21 10:14:40,391 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/86c0cdabf731340ea1b965371f5387ef 2023-07-21 10:14:40,392 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dfb877ee2acda63388da237538597f0b/cf/7e8c5a1d184e44e5a0f9bd1b02aca158 to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/dfb877ee2acda63388da237538597f0b/cf/7e8c5a1d184e44e5a0f9bd1b02aca158 2023-07-21 10:14:40,395 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dfb877ee2acda63388da237538597f0b/recovered.edits/9.seqid to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/dfb877ee2acda63388da237538597f0b/recovered.edits/9.seqid 2023-07-21 10:14:40,396 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/dfb877ee2acda63388da237538597f0b 2023-07-21 10:14:40,396 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-21 10:14:40,397 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-21 10:14:40,398 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-21 10:14:40,407 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230721564c24bd85f0438f8d1f8a12f7f83e54 to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230721564c24bd85f0438f8d1f8a12f7f83e54 2023-07-21 10:14:40,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-21 10:14:40,416 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230721821a4fb0d1e54710b906715e8d671d22 to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230721821a4fb0d1e54710b906715e8d671d22 2023-07-21 10:14:40,417 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-21 10:14:40,429 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:40,445 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-21 10:14:40,459 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-21 10:14:40,467 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:40,467 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-21 10:14:40,467 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689934439099.dfb877ee2acda63388da237538597f0b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689934480467"}]},"ts":"9223372036854775807"} 2023-07-21 10:14:40,467 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689934439099.86c0cdabf731340ea1b965371f5387ef.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689934480467"}]},"ts":"9223372036854775807"} 2023-07-21 10:14:40,477 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-21 10:14:40,477 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => dfb877ee2acda63388da237538597f0b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689934439099.dfb877ee2acda63388da237538597f0b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 86c0cdabf731340ea1b965371f5387ef, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689934439099.86c0cdabf731340ea1b965371f5387ef.', STARTKEY => '1', ENDKEY => ''}] 2023-07-21 10:14:40,477 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-21 10:14:40,477 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689934480477"}]},"ts":"9223372036854775807"} 2023-07-21 10:14:40,479 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-21 10:14:40,482 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:40,486 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 209 msec 2023-07-21 10:14:40,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-21 10:14:40,622 INFO [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-21 10:14:40,669 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-21 10:14:40,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:40,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-21 10:14:40,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:40,688 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-21 10:14:40,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:40,752 INFO [Listener at jenkins-hbase17.apache.org/42227] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=750 (was 743) Potentially hanging thread: hconnection-0x1bf23fcf-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1bf23fcf-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1bf23fcf-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1bf23fcf-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1bf23fcf-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4111 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1557406679_17 at /127.0.0.1:45300 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1557406679_17 at /127.0.0.1:59214 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1557406679_17 at /127.0.0.1:53674 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1bf23fcf-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (804182503) connection to jenkins-hbase17.apache.org/136.243.18.41:34341 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=895 (was 898), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1602 (was 1259) - SystemLoadAverage LEAK? -, ProcessCount=191 (was 196), AvailableMemoryMB=1643 (was 872) - AvailableMemoryMB LEAK? - 2023-07-21 10:14:40,753 WARN [Listener at jenkins-hbase17.apache.org/42227] hbase.ResourceChecker(130): Thread=750 is superior to 500 2023-07-21 10:14:40,842 INFO [Listener at jenkins-hbase17.apache.org/42227] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=750, OpenFileDescriptor=895, MaxFileDescriptor=60000, SystemLoadAverage=1602, ProcessCount=193, AvailableMemoryMB=1638 2023-07-21 10:14:40,842 WARN [Listener at jenkins-hbase17.apache.org/42227] hbase.ResourceChecker(130): Thread=750 is superior to 500 2023-07-21 10:14:40,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-21 10:14:40,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 10:14:40,865 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 10:14:40,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-21 10:14:40,872 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 10:14:40,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-21 10:14:40,896 DEBUG [HFileArchiver-24] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testEmptyExportFileSystemState/e6c30291acc59bf0f7b5dac49c98c375 2023-07-21 10:14:40,896 DEBUG [HFileArchiver-25] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testEmptyExportFileSystemState/3e361bfa6fa27b2c41a2d8979f4679fe 2023-07-21 10:14:40,901 DEBUG [HFileArchiver-24] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testEmptyExportFileSystemState/e6c30291acc59bf0f7b5dac49c98c375 empty. 2023-07-21 10:14:40,906 DEBUG [HFileArchiver-25] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testEmptyExportFileSystemState/3e361bfa6fa27b2c41a2d8979f4679fe empty. 2023-07-21 10:14:40,911 DEBUG [HFileArchiver-25] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testEmptyExportFileSystemState/3e361bfa6fa27b2c41a2d8979f4679fe 2023-07-21 10:14:40,914 DEBUG [HFileArchiver-24] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testEmptyExportFileSystemState/e6c30291acc59bf0f7b5dac49c98c375 2023-07-21 10:14:40,916 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-21 10:14:40,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-21 10:14:41,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-21 10:14:41,462 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-21 10:14:41,469 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => e6c30291acc59bf0f7b5dac49c98c375, NAME => 'testtb-testEmptyExportFileSystemState,,1689934480849.e6c30291acc59bf0f7b5dac49c98c375.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp 2023-07-21 10:14:41,481 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 3e361bfa6fa27b2c41a2d8979f4679fe, NAME => 'testtb-testEmptyExportFileSystemState,1,1689934480849.3e361bfa6fa27b2c41a2d8979f4679fe.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp 2023-07-21 10:14:41,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-21 10:14:41,680 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689934480849.3e361bfa6fa27b2c41a2d8979f4679fe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:14:41,680 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 3e361bfa6fa27b2c41a2d8979f4679fe, disabling compactions & flushes 2023-07-21 10:14:41,680 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689934480849.3e361bfa6fa27b2c41a2d8979f4679fe. 2023-07-21 10:14:41,680 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689934480849.3e361bfa6fa27b2c41a2d8979f4679fe. 2023-07-21 10:14:41,680 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689934480849.3e361bfa6fa27b2c41a2d8979f4679fe. after waiting 0 ms 2023-07-21 10:14:41,680 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689934480849.3e361bfa6fa27b2c41a2d8979f4679fe. 2023-07-21 10:14:41,680 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689934480849.3e361bfa6fa27b2c41a2d8979f4679fe. 2023-07-21 10:14:41,680 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 3e361bfa6fa27b2c41a2d8979f4679fe: 2023-07-21 10:14:41,682 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689934480849.e6c30291acc59bf0f7b5dac49c98c375.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:14:41,682 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing e6c30291acc59bf0f7b5dac49c98c375, disabling compactions & flushes 2023-07-21 10:14:41,682 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689934480849.e6c30291acc59bf0f7b5dac49c98c375. 2023-07-21 10:14:41,682 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689934480849.e6c30291acc59bf0f7b5dac49c98c375. 2023-07-21 10:14:41,683 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689934480849.e6c30291acc59bf0f7b5dac49c98c375. after waiting 0 ms 2023-07-21 10:14:41,683 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689934480849.e6c30291acc59bf0f7b5dac49c98c375. 2023-07-21 10:14:41,683 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689934480849.e6c30291acc59bf0f7b5dac49c98c375. 2023-07-21 10:14:41,683 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for e6c30291acc59bf0f7b5dac49c98c375: 2023-07-21 10:14:41,688 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 10:14:41,689 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689934480849.3e361bfa6fa27b2c41a2d8979f4679fe.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689934481688"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934481688"}]},"ts":"1689934481688"} 2023-07-21 10:14:41,689 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689934480849.e6c30291acc59bf0f7b5dac49c98c375.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689934481688"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934481688"}]},"ts":"1689934481688"} 2023-07-21 10:14:41,691 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-21 10:14:41,697 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 10:14:41,697 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934481697"}]},"ts":"1689934481697"} 2023-07-21 10:14:41,699 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-21 10:14:41,702 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-21 10:14:41,714 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 10:14:41,714 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 10:14:41,714 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 10:14:41,714 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 10:14:41,715 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e6c30291acc59bf0f7b5dac49c98c375, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3e361bfa6fa27b2c41a2d8979f4679fe, ASSIGN}] 2023-07-21 10:14:41,718 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e6c30291acc59bf0f7b5dac49c98c375, ASSIGN 2023-07-21 10:14:41,725 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e6c30291acc59bf0f7b5dac49c98c375, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,37151,1689934329015; forceNewPlan=false, retain=false 2023-07-21 10:14:41,725 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3e361bfa6fa27b2c41a2d8979f4679fe, ASSIGN 2023-07-21 10:14:41,733 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3e361bfa6fa27b2c41a2d8979f4679fe, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,36809,1689934328937; forceNewPlan=false, retain=false 2023-07-21 10:14:41,880 INFO [jenkins-hbase17:35385] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-21 10:14:41,888 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=e6c30291acc59bf0f7b5dac49c98c375, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:41,889 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689934480849.e6c30291acc59bf0f7b5dac49c98c375.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689934481888"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934481888"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934481888"}]},"ts":"1689934481888"} 2023-07-21 10:14:41,892 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=3e361bfa6fa27b2c41a2d8979f4679fe, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:41,892 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689934480849.3e361bfa6fa27b2c41a2d8979f4679fe.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689934481892"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934481892"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934481892"}]},"ts":"1689934481892"} 2023-07-21 10:14:41,895 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure e6c30291acc59bf0f7b5dac49c98c375, server=jenkins-hbase17.apache.org,37151,1689934329015}] 2023-07-21 10:14:41,900 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 3e361bfa6fa27b2c41a2d8979f4679fe, server=jenkins-hbase17.apache.org,36809,1689934328937}] 2023-07-21 10:14:41,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-21 10:14:42,065 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689934480849.3e361bfa6fa27b2c41a2d8979f4679fe. 2023-07-21 10:14:42,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3e361bfa6fa27b2c41a2d8979f4679fe, NAME => 'testtb-testEmptyExportFileSystemState,1,1689934480849.3e361bfa6fa27b2c41a2d8979f4679fe.', STARTKEY => '1', ENDKEY => ''} 2023-07-21 10:14:42,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689934480849.3e361bfa6fa27b2c41a2d8979f4679fe. service=AccessControlService 2023-07-21 10:14:42,066 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:14:42,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 3e361bfa6fa27b2c41a2d8979f4679fe 2023-07-21 10:14:42,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689934480849.3e361bfa6fa27b2c41a2d8979f4679fe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:14:42,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 3e361bfa6fa27b2c41a2d8979f4679fe 2023-07-21 10:14:42,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 3e361bfa6fa27b2c41a2d8979f4679fe 2023-07-21 10:14:42,072 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689934480849.e6c30291acc59bf0f7b5dac49c98c375. 2023-07-21 10:14:42,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e6c30291acc59bf0f7b5dac49c98c375, NAME => 'testtb-testEmptyExportFileSystemState,,1689934480849.e6c30291acc59bf0f7b5dac49c98c375.', STARTKEY => '', ENDKEY => '1'} 2023-07-21 10:14:42,072 INFO [StoreOpener-3e361bfa6fa27b2c41a2d8979f4679fe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3e361bfa6fa27b2c41a2d8979f4679fe 2023-07-21 10:14:42,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689934480849.e6c30291acc59bf0f7b5dac49c98c375. service=AccessControlService 2023-07-21 10:14:42,073 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:14:42,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState e6c30291acc59bf0f7b5dac49c98c375 2023-07-21 10:14:42,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689934480849.e6c30291acc59bf0f7b5dac49c98c375.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:14:42,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for e6c30291acc59bf0f7b5dac49c98c375 2023-07-21 10:14:42,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for e6c30291acc59bf0f7b5dac49c98c375 2023-07-21 10:14:42,085 DEBUG [StoreOpener-3e361bfa6fa27b2c41a2d8979f4679fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testEmptyExportFileSystemState/3e361bfa6fa27b2c41a2d8979f4679fe/cf 2023-07-21 10:14:42,085 DEBUG [StoreOpener-3e361bfa6fa27b2c41a2d8979f4679fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testEmptyExportFileSystemState/3e361bfa6fa27b2c41a2d8979f4679fe/cf 2023-07-21 10:14:42,086 INFO [StoreOpener-3e361bfa6fa27b2c41a2d8979f4679fe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3e361bfa6fa27b2c41a2d8979f4679fe columnFamilyName cf 2023-07-21 10:14:42,092 INFO [StoreOpener-e6c30291acc59bf0f7b5dac49c98c375-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e6c30291acc59bf0f7b5dac49c98c375 2023-07-21 10:14:42,109 INFO [StoreOpener-3e361bfa6fa27b2c41a2d8979f4679fe-1] regionserver.HStore(310): Store=3e361bfa6fa27b2c41a2d8979f4679fe/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:14:42,109 DEBUG [StoreOpener-e6c30291acc59bf0f7b5dac49c98c375-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testEmptyExportFileSystemState/e6c30291acc59bf0f7b5dac49c98c375/cf 2023-07-21 10:14:42,111 DEBUG [StoreOpener-e6c30291acc59bf0f7b5dac49c98c375-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testEmptyExportFileSystemState/e6c30291acc59bf0f7b5dac49c98c375/cf 2023-07-21 10:14:42,112 INFO [StoreOpener-e6c30291acc59bf0f7b5dac49c98c375-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e6c30291acc59bf0f7b5dac49c98c375 columnFamilyName cf 2023-07-21 10:14:42,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testEmptyExportFileSystemState/3e361bfa6fa27b2c41a2d8979f4679fe 2023-07-21 10:14:42,117 INFO [StoreOpener-e6c30291acc59bf0f7b5dac49c98c375-1] regionserver.HStore(310): Store=e6c30291acc59bf0f7b5dac49c98c375/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:14:42,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testEmptyExportFileSystemState/3e361bfa6fa27b2c41a2d8979f4679fe 2023-07-21 10:14:42,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testEmptyExportFileSystemState/e6c30291acc59bf0f7b5dac49c98c375 2023-07-21 10:14:42,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testEmptyExportFileSystemState/e6c30291acc59bf0f7b5dac49c98c375 2023-07-21 10:14:42,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 3e361bfa6fa27b2c41a2d8979f4679fe 2023-07-21 10:14:42,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for e6c30291acc59bf0f7b5dac49c98c375 2023-07-21 10:14:42,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testEmptyExportFileSystemState/3e361bfa6fa27b2c41a2d8979f4679fe/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 10:14:42,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testEmptyExportFileSystemState/e6c30291acc59bf0f7b5dac49c98c375/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 10:14:42,142 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 3e361bfa6fa27b2c41a2d8979f4679fe; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69441633, jitterRate=0.0347609668970108}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 10:14:42,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 3e361bfa6fa27b2c41a2d8979f4679fe: 2023-07-21 10:14:42,143 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened e6c30291acc59bf0f7b5dac49c98c375; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62018813, jitterRate=-0.07584767043590546}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 10:14:42,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for e6c30291acc59bf0f7b5dac49c98c375: 2023-07-21 10:14:42,145 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689934480849.e6c30291acc59bf0f7b5dac49c98c375., pid=93, masterSystemTime=1689934482056 2023-07-21 10:14:42,145 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689934480849.3e361bfa6fa27b2c41a2d8979f4679fe., pid=94, masterSystemTime=1689934482056 2023-07-21 10:14:42,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689934480849.3e361bfa6fa27b2c41a2d8979f4679fe. 2023-07-21 10:14:42,151 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689934480849.3e361bfa6fa27b2c41a2d8979f4679fe. 2023-07-21 10:14:42,152 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=3e361bfa6fa27b2c41a2d8979f4679fe, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:42,152 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689934480849.3e361bfa6fa27b2c41a2d8979f4679fe.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689934482152"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689934482152"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689934482152"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689934482152"}]},"ts":"1689934482152"} 2023-07-21 10:14:42,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689934480849.e6c30291acc59bf0f7b5dac49c98c375. 2023-07-21 10:14:42,153 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689934480849.e6c30291acc59bf0f7b5dac49c98c375. 2023-07-21 10:14:42,154 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=e6c30291acc59bf0f7b5dac49c98c375, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:42,154 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689934480849.e6c30291acc59bf0f7b5dac49c98c375.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689934482154"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689934482154"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689934482154"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689934482154"}]},"ts":"1689934482154"} 2023-07-21 10:14:42,159 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-21 10:14:42,159 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 3e361bfa6fa27b2c41a2d8979f4679fe, server=jenkins-hbase17.apache.org,36809,1689934328937 in 255 msec 2023-07-21 10:14:42,163 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-21 10:14:42,163 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure e6c30291acc59bf0f7b5dac49c98c375, server=jenkins-hbase17.apache.org,37151,1689934329015 in 262 msec 2023-07-21 10:14:42,164 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3e361bfa6fa27b2c41a2d8979f4679fe, ASSIGN in 445 msec 2023-07-21 10:14:42,176 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-21 10:14:42,177 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e6c30291acc59bf0f7b5dac49c98c375, ASSIGN in 448 msec 2023-07-21 10:14:42,184 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 10:14:42,185 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934482184"}]},"ts":"1689934482184"} 2023-07-21 10:14:42,200 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-21 10:14:42,212 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 10:14:42,213 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-21 10:14:42,229 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37151] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-21 10:14:42,234 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:42,235 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:42,235 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:42,235 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:42,236 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 10:14:42,236 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 10:14:42,237 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 10:14:42,237 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 10:14:42,240 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 1.3860 sec 2023-07-21 10:14:42,486 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-21 10:14:42,541 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934340509_0005_000001 (auth:SIMPLE) 2023-07-21 10:14:42,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-21 10:14:42,990 INFO [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-21 10:14:43,006 DEBUG [Listener at jenkins-hbase17.apache.org/42227] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-21 10:14:43,006 DEBUG [Listener at jenkins-hbase17.apache.org/42227] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689934480849.e6c30291acc59bf0f7b5dac49c98c375. 2023-07-21 10:14:43,016 INFO [Listener at jenkins-hbase17.apache.org/42227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 10:14:43,051 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 10:14:43,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689934483051 (current time:1689934483051). 2023-07-21 10:14:43,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 10:14:43,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] zookeeper.ReadOnlyZKClient(139): Connect 0x74a94428 to 127.0.0.1:56971 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:14:43,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1772b1b7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:14:43,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:14:43,086 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:36404, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:14:43,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x74a94428 to 127.0.0.1:56971 2023-07-21 10:14:43,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:14:43,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] zookeeper.ReadOnlyZKClient(139): Connect 0x7094f87f to 127.0.0.1:56971 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:14:43,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e226a41, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:14:43,102 DEBUG [hconnection-0x4cdf853b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:14:43,105 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:36420, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:14:43,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:14:43,119 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:53894, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:14:43,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7094f87f to 127.0.0.1:56971 2023-07-21 10:14:43,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:14:43,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-21 10:14:43,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 10:14:43,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 10:14:43,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-21 10:14:43,142 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-21 10:14:43,144 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689935083144 2023-07-21 10:14:43,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 10:14:43,145 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-21 10:14:43,148 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 10:14:43,149 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 10:14:43,160 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-21 10:14:43,161 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-21 10:14:43,161 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 37 msec 2023-07-21 10:14:43,166 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-21 10:14:43,167 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689935083166 2023-07-21 10:14:43,189 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,189 INFO [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-21 10:14:43,191 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:14:43,192 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-21 10:14:43,192 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-21 10:14:43,193 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,193 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,197 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:43,197 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:43,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:43,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:43,197 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:43,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:43,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:43,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:43,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:43,197 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:43,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,198 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,198 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:43,198 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:43,200 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-21 10:14:43,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,201 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-21 10:14:43,201 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,201 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:43,201 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 10:14:43,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-21 10:14:43,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,201 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-21 10:14:43,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-21 10:14:43,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,201 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-21 10:14:43,208 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,208 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-21 10:14:43,208 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:14:43,221 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,221 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-21 10:14:43,221 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:14:43,222 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,261 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:14:43,261 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-21 10:14:43,261 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-21 10:14:43,261 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36809,1689934328937' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-21 10:14:43,262 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-21 10:14:43,262 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-21 10:14:43,262 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,38751,1689934329069' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-21 10:14:43,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 10:14:43,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:14:43,263 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 10:14:43,264 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:43,264 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:43,264 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-21 10:14:43,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:43,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:43,264 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:14:43,266 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-21 10:14:43,266 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-21 10:14:43,266 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,37151,1689934329015' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-21 10:14:43,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:43,266 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,266 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,266 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:14:43,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:43,267 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,267 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:14:43,268 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:43,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,269 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:43,269 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,269 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:14:43,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:43,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:43,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:43,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,36809,1689934328937' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-21 10:14:43,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1308503d[Count = 1] remaining members to acquire global barrier 2023-07-21 10:14:43,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:43,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:43,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:43,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:43,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:43,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:43,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:43,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:43,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:43,272 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,37151,1689934329015' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-21 10:14:43,272 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1308503d[Count = 0] remaining members to acquire global barrier 2023-07-21 10:14:43,272 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-21 10:14:43,272 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,273 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,273 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,273 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-21 10:14:43,273 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:43,273 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,273 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:14:43,273 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:14:43,273 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-21 10:14:43,273 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689934480849.e6c30291acc59bf0f7b5dac49c98c375. 2023-07-21 10:14:43,273 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:43,273 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 10:14:43,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,273 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689934480849.e6c30291acc59bf0f7b5dac49c98c375. started... 2023-07-21 10:14:43,274 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-21 10:14:43,274 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-21 10:14:43,274 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,38751,1689934329069' in zk 2023-07-21 10:14:43,274 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:14:43,274 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:14:43,274 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e6c30291acc59bf0f7b5dac49c98c375: 2023-07-21 10:14:43,274 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689934480849.3e361bfa6fa27b2c41a2d8979f4679fe. 2023-07-21 10:14:43,274 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689934480849.3e361bfa6fa27b2c41a2d8979f4679fe. started... 2023-07-21 10:14:43,274 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689934480849.e6c30291acc59bf0f7b5dac49c98c375.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,276 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:14:43,276 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 10:14:43,276 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3e361bfa6fa27b2c41a2d8979f4679fe: 2023-07-21 10:14:43,277 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689934480849.3e361bfa6fa27b2c41a2d8979f4679fe.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,277 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:14:43,277 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 10:14:43,278 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-21 10:14:43,278 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:14:43,278 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-21 10:14:43,322 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689934480849.e6c30291acc59bf0f7b5dac49c98c375. completed. 2023-07-21 10:14:43,322 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689934480849.e6c30291acc59bf0f7b5dac49c98c375. 2023-07-21 10:14:43,322 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:14:43,322 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:14:43,323 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:43,323 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-21 10:14:43,323 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,37151,1689934329015' in zk 2023-07-21 10:14:43,328 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-21 10:14:43,328 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:14:43,331 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-21 10:14:43,331 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:43,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:43,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:43,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:43,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:43,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:43,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:43,339 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689934480849.3e361bfa6fa27b2c41a2d8979f4679fe. completed. 2023-07-21 10:14:43,339 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689934480849.3e361bfa6fa27b2c41a2d8979f4679fe. 2023-07-21 10:14:43,339 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:14:43,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:43,339 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:14:43,340 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:43,340 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-21 10:14:43,340 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,36809,1689934328937' in zk 2023-07-21 10:14:43,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:43,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:43,342 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:43,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,343 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-21 10:14:43,343 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:14:43,343 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-21 10:14:43,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:43,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:43,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:43,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase17.apache.org,37151,1689934329015': 2023-07-21 10:14:43,346 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,37151,1689934329015' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-21 10:14:43,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:43,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:43,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:43,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:43,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:43,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:43,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:43,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:43,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:43,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:43,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:43,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:43,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase17.apache.org,36809,1689934328937': 2023-07-21 10:14:43,349 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,36809,1689934328937' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-21 10:14:43,349 INFO [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-21 10:14:43,349 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 10:14:43,349 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 10:14:43,349 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,349 INFO [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 10:14:43,350 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,350 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:43,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,350 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,351 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:43,351 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:43,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:43,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:43,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:43,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:43,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:43,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:43,358 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,358 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:43,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,364 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:43,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:43,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:43,365 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:43,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,365 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:43,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:43,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:43,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:43,372 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:43,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:43,372 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:43,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:43,373 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:43,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:43,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:43,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:43,375 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:43,375 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:43,376 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:43,375 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:43,376 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:43,376 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:14:43,376 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,376 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:43,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:43,380 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:43,377 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:43,376 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:43,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:43,376 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-21 10:14:43,380 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:43,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-21 10:14:43,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:43,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:43,380 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:43,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:43,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:43,380 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:43,380 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,381 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:43,381 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:43,381 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,381 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:43,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:43,388 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-21 10:14:43,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:43,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:43,409 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,410 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,436 WARN [DataStreamer for file /user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState/data.manifest] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-21 10:14:43,463 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:14:43,464 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 10:14:43,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:14:43,466 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 10:14:43,547 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 10:14:43,766 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:14:43,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 10:14:43,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:14:43,767 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-21 10:14:43,926 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-21 10:14:43,926 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,926 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,926 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689934483145Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689934483409 (+264 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689934483409Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689934483409Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689934483421 (+12 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689934483445 (+24 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689934483926 (+481 ms) 2023-07-21 10:14:43,930 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-21 10:14:43,932 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 779 msec 2023-07-21 10:14:44,267 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:14:44,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 10:14:44,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 10:14:44,294 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37151] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689934480849.e6c30291acc59bf0f7b5dac49c98c375. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 10:14:44,295 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36809] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689934480849.3e361bfa6fa27b2c41a2d8979f4679fe. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 10:14:44,306 DEBUG [Listener at jenkins-hbase17.apache.org/42227] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-21 10:14:44,306 DEBUG [Listener at jenkins-hbase17.apache.org/42227] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689934480849.e6c30291acc59bf0f7b5dac49c98c375. 2023-07-21 10:14:44,306 INFO [Listener at jenkins-hbase17.apache.org/42227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 10:14:44,335 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 10:14:44,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689934484335 (current time:1689934484335). 2023-07-21 10:14:44,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 10:14:44,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] zookeeper.ReadOnlyZKClient(139): Connect 0x38e5f028 to 127.0.0.1:56971 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:14:44,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8234c52, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:14:44,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:14:44,373 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:36422, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:14:44,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x38e5f028 to 127.0.0.1:56971 2023-07-21 10:14:44,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:14:44,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] zookeeper.ReadOnlyZKClient(139): Connect 0x5dff2a7d to 127.0.0.1:56971 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:14:44,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a0ce55a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:14:44,416 DEBUG [hconnection-0x58df7195-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:14:44,421 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:36432, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:14:44,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:14:44,434 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:53896, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:14:44,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5dff2a7d to 127.0.0.1:56971 2023-07-21 10:14:44,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:14:44,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-21 10:14:44,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 10:14:44,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 10:14:44,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-21 10:14:44,450 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-21 10:14:44,454 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689935084454 2023-07-21 10:14:44,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 10:14:44,455 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-21 10:14:44,457 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 10:14:44,457 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 10:14:44,458 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-21 10:14:44,459 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-21 10:14:44,463 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 17 msec 2023-07-21 10:14:44,467 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-21 10:14:44,468 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689935084468 2023-07-21 10:14:44,499 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:44,500 INFO [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-21 10:14:44,500 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:14:44,501 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-21 10:14:44,501 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-21 10:14:44,546 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:44,546 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:44,547 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:44,547 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:44,547 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:44,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:44,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:44,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:44,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:44,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:44,548 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:44,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:44,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:44,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:44,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:44,548 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:44,548 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:44,548 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:44,548 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:44,548 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:44,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-21 10:14:44,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:44,549 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-21 10:14:44,549 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:44,550 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-21 10:14:44,550 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:14:44,554 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-21 10:14:44,554 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-21 10:14:44,554 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,38751,1689934329069' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-21 10:14:44,555 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:44,555 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:44,555 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:14:44,557 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:14:44,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 10:14:44,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:14:44,559 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 10:14:44,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-21 10:14:44,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:44,564 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-21 10:14:44,564 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:44,564 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 10:14:44,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-21 10:14:44,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:44,564 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-21 10:14:44,572 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:44,572 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-21 10:14:44,572 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:14:44,573 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:44,590 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-21 10:14:44,590 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:14:44,594 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-21 10:14:44,594 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-21 10:14:44,595 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36809,1689934328937' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-21 10:14:44,595 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-21 10:14:44,595 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-21 10:14:44,595 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,37151,1689934329015' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-21 10:14:44,760 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:14:44,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 10:14:44,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:14:44,762 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 10:14:45,062 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:14:45,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 10:14:45,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:14:45,063 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-21 10:14:45,339 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,339 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,340 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:45,340 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:45,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:45,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:45,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:45,344 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:45,345 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,345 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:14:45,345 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:14:45,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:45,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:45,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:45,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:45,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:45,348 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,36809,1689934328937' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-21 10:14:45,349 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1aedc0e6[Count = 1] remaining members to acquire global barrier 2023-07-21 10:14:45,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:45,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:45,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:45,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:45,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:45,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:45,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:45,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:45,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:45,351 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,37151,1689934329015' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-21 10:14:45,351 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1aedc0e6[Count = 0] remaining members to acquire global barrier 2023-07-21 10:14:45,351 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-21 10:14:45,351 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,498 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,498 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,499 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:45,499 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-21 10:14:45,499 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:45,499 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 10:14:45,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,500 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,500 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-21 10:14:45,500 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-21 10:14:45,500 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,38751,1689934329069' in zk 2023-07-21 10:14:45,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,502 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-21 10:14:45,510 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:14:45,510 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:14:45,510 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689934480849.e6c30291acc59bf0f7b5dac49c98c375. 2023-07-21 10:14:45,510 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689934480849.e6c30291acc59bf0f7b5dac49c98c375. started... 2023-07-21 10:14:45,516 INFO [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e6c30291acc59bf0f7b5dac49c98c375 1/1 column families, dataSize=65 B heapSize=400 B 2023-07-21 10:14:45,520 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689934480849.3e361bfa6fa27b2c41a2d8979f4679fe. 2023-07-21 10:14:45,529 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689934480849.3e361bfa6fa27b2c41a2d8979f4679fe. started... 2023-07-21 10:14:45,529 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-21 10:14:45,529 INFO [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3e361bfa6fa27b2c41a2d8979f4679fe 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-07-21 10:14:45,520 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:14:45,530 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:14:45,529 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:14:45,530 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-21 10:14:45,564 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:14:45,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 10:14:45,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:14:45,567 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-21 10:14:45,644 INFO [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307214d9810e48ef6495dba199a9973c60f6a to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307214d9810e48ef6495dba199a9973c60f6a 2023-07-21 10:14:45,680 INFO [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307215c31420662d044d5afc78f07ece02095 to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307215c31420662d044d5afc78f07ece02095 2023-07-21 10:14:45,763 INFO [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.2 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testEmptyExportFileSystemState/3e361bfa6fa27b2c41a2d8979f4679fe/.tmp/cf/ceeede4a03ea4bba837640de12887365 2023-07-21 10:14:45,781 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testEmptyExportFileSystemState/3e361bfa6fa27b2c41a2d8979f4679fe/.tmp/cf/ceeede4a03ea4bba837640de12887365 as hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testEmptyExportFileSystemState/3e361bfa6fa27b2c41a2d8979f4679fe/cf/ceeede4a03ea4bba837640de12887365 2023-07-21 10:14:45,789 INFO [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testEmptyExportFileSystemState/3e361bfa6fa27b2c41a2d8979f4679fe/cf/ceeede4a03ea4bba837640de12887365, entries=49, sequenceid=6, filesize=13.4 K 2023-07-21 10:14:45,791 INFO [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for 3e361bfa6fa27b2c41a2d8979f4679fe in 262ms, sequenceid=6, compaction requested=false 2023-07-21 10:14:45,793 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3e361bfa6fa27b2c41a2d8979f4679fe: 2023-07-21 10:14:45,793 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689934480849.3e361bfa6fa27b2c41a2d8979f4679fe.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,793 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:14:45,793 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testEmptyExportFileSystemState/3e361bfa6fa27b2c41a2d8979f4679fe/cf/ceeede4a03ea4bba837640de12887365] hfiles 2023-07-21 10:14:45,794 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testEmptyExportFileSystemState/3e361bfa6fa27b2c41a2d8979f4679fe/cf/ceeede4a03ea4bba837640de12887365 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,801 INFO [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=65, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testEmptyExportFileSystemState/e6c30291acc59bf0f7b5dac49c98c375/.tmp/cf/affd37d4f4e04ec68ce074fe20ade9af 2023-07-21 10:14:45,816 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testEmptyExportFileSystemState/e6c30291acc59bf0f7b5dac49c98c375/.tmp/cf/affd37d4f4e04ec68ce074fe20ade9af as hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testEmptyExportFileSystemState/e6c30291acc59bf0f7b5dac49c98c375/cf/affd37d4f4e04ec68ce074fe20ade9af 2023-07-21 10:14:45,830 INFO [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testEmptyExportFileSystemState/e6c30291acc59bf0f7b5dac49c98c375/cf/affd37d4f4e04ec68ce074fe20ade9af, entries=1, sequenceid=6, filesize=5.1 K 2023-07-21 10:14:45,835 INFO [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for e6c30291acc59bf0f7b5dac49c98c375 in 319ms, sequenceid=6, compaction requested=false 2023-07-21 10:14:45,835 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e6c30291acc59bf0f7b5dac49c98c375: 2023-07-21 10:14:45,835 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689934480849.e6c30291acc59bf0f7b5dac49c98c375.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,842 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:14:45,842 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testEmptyExportFileSystemState/e6c30291acc59bf0f7b5dac49c98c375/cf/affd37d4f4e04ec68ce074fe20ade9af] hfiles 2023-07-21 10:14:45,842 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testEmptyExportFileSystemState/e6c30291acc59bf0f7b5dac49c98c375/cf/affd37d4f4e04ec68ce074fe20ade9af for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,875 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689934480849.3e361bfa6fa27b2c41a2d8979f4679fe. completed. 2023-07-21 10:14:45,875 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689934480849.3e361bfa6fa27b2c41a2d8979f4679fe. 2023-07-21 10:14:45,875 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:14:45,875 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:14:45,875 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:45,875 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-21 10:14:45,875 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,36809,1689934328937' in zk 2023-07-21 10:14:45,877 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:45,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:45,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:45,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:45,877 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-21 10:14:45,877 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:14:45,877 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-21 10:14:45,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:45,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:45,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:45,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:45,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:45,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:45,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:45,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:45,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase17.apache.org,36809,1689934328937': 2023-07-21 10:14:45,881 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,36809,1689934328937' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-21 10:14:45,902 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689934480849.e6c30291acc59bf0f7b5dac49c98c375. completed. 2023-07-21 10:14:45,902 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689934480849.e6c30291acc59bf0f7b5dac49c98c375. 2023-07-21 10:14:45,902 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:14:45,902 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:14:45,902 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:45,903 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-21 10:14:45,903 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,37151,1689934329015' in zk 2023-07-21 10:14:45,904 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-21 10:14:45,904 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:14:45,904 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-21 10:14:45,904 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:45,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:45,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:45,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:45,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:45,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:45,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:45,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:45,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:45,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:45,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:45,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:45,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:45,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase17.apache.org,37151,1689934329015': 2023-07-21 10:14:45,910 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,37151,1689934329015' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-21 10:14:45,910 INFO [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-21 10:14:45,910 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 10:14:45,910 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 10:14:45,910 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,910 INFO [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 10:14:45,911 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,911 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:45,911 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:45,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:45,911 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,911 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,912 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:45,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,911 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:45,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:45,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:45,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:45,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:45,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:45,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:45,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:45,913 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:45,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,913 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:45,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:45,914 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:45,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:45,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:45,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:45,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:45,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,915 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:45,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:45,915 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:45,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:45,916 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:45,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:45,918 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:45,918 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,918 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:45,918 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:45,918 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,918 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:45,918 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,918 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:14:45,918 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:45,918 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:45,918 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:45,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:45,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:45,918 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:45,918 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:45,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:45,918 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,919 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:45,919 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-21 10:14:45,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:45,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:45,919 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,919 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-21 10:14:45,918 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,921 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,919 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:45,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:45,918 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:14:45,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:45,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:45,922 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307214d9810e48ef6495dba199a9973c60f6a, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307215c31420662d044d5afc78f07ece02095] mob files 2023-07-21 10:14:45,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:45,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:45,922 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307214d9810e48ef6495dba199a9973c60f6a 2023-07-21 10:14:45,923 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307215c31420662d044d5afc78f07ece02095 2023-07-21 10:14:45,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:45,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:45,975 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:45,977 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:46,113 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:46,164 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-21 10:14:46,164 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:46,165 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:46,165 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689934484455Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689934485975 (+1520 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689934485975Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689934485975Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689934486018 (+43 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689934486092 (+74 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689934486164 (+72 ms) 2023-07-21 10:14:46,168 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-21 10:14:46,170 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 1.7110 sec 2023-07-21 10:14:46,568 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:14:46,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 10:14:46,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 10:14:46,569 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934486569 2023-07-21 10:14:46,569 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost.localdomain:35937, tgtDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934486569, rawTgtDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934486569, srcFsUri=hdfs://localhost.localdomain:35937, srcDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f 2023-07-21 10:14:46,620 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:35937, inputRoot=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f 2023-07-21 10:14:46,620 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_477139401_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934486569, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934486569/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:46,620 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:35937, inputRoot=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f, snapshotDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-21 10:14:46,637 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934486569/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:46,705 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:46,706 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:46,706 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:46,706 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:46,707 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:46,707 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:46,707 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:46,797 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/hadoop-4884830109483616078.jar 2023-07-21 10:14:46,797 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:46,798 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:46,798 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:46,799 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:46,799 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:46,800 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:46,800 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-21 10:14:46,801 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-21 10:14:46,801 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-21 10:14:46,802 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-21 10:14:46,802 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-21 10:14:46,803 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-21 10:14:46,804 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-21 10:14:46,804 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-21 10:14:46,805 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-21 10:14:46,805 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-21 10:14:46,806 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:14:46,806 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:14:46,807 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 10:14:46,807 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:14:46,807 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:14:46,808 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 10:14:46,808 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 10:14:48,685 WARN [Listener at jenkins-hbase17.apache.org/42227] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-21 10:14:48,687 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-21 10:14:48,957 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 10:14:48,957 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 10:14:49,388 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934340509_0006_000001 (auth:SIMPLE) 2023-07-21 10:14:55,563 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934340509_0006_000001 (auth:SIMPLE) 2023-07-21 10:14:58,325 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-21 10:14:58,326 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-21 10:14:58,338 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:58,338 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-21 10:14:58,341 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-21 10:14:58,341 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1557406679_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:58,342 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-21 10:14:58,342 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-21 10:14:58,342 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1557406679_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934486569/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934486569/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:58,342 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934486569/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-21 10:14:58,342 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934486569/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-21 10:14:58,348 INFO [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-21 10:14:58,349 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testEmptyExportFileSystemState 2023-07-21 10:14:58,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 10:14:58,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-21 10:14:58,357 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934498357"}]},"ts":"1689934498357"} 2023-07-21 10:14:58,359 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-21 10:14:58,360 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-21 10:14:58,365 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e6c30291acc59bf0f7b5dac49c98c375, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3e361bfa6fa27b2c41a2d8979f4679fe, UNASSIGN}] 2023-07-21 10:14:58,370 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e6c30291acc59bf0f7b5dac49c98c375, UNASSIGN 2023-07-21 10:14:58,370 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3e361bfa6fa27b2c41a2d8979f4679fe, UNASSIGN 2023-07-21 10:14:58,371 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=e6c30291acc59bf0f7b5dac49c98c375, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:58,371 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=3e361bfa6fa27b2c41a2d8979f4679fe, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:58,371 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689934480849.e6c30291acc59bf0f7b5dac49c98c375.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689934498371"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934498371"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934498371"}]},"ts":"1689934498371"} 2023-07-21 10:14:58,371 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689934480849.3e361bfa6fa27b2c41a2d8979f4679fe.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689934498371"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934498371"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934498371"}]},"ts":"1689934498371"} 2023-07-21 10:14:58,374 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure e6c30291acc59bf0f7b5dac49c98c375, server=jenkins-hbase17.apache.org,37151,1689934329015}] 2023-07-21 10:14:58,375 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 3e361bfa6fa27b2c41a2d8979f4679fe, server=jenkins-hbase17.apache.org,36809,1689934328937}] 2023-07-21 10:14:58,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-21 10:14:58,526 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close e6c30291acc59bf0f7b5dac49c98c375 2023-07-21 10:14:58,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing e6c30291acc59bf0f7b5dac49c98c375, disabling compactions & flushes 2023-07-21 10:14:58,526 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689934480849.e6c30291acc59bf0f7b5dac49c98c375. 2023-07-21 10:14:58,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689934480849.e6c30291acc59bf0f7b5dac49c98c375. 2023-07-21 10:14:58,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689934480849.e6c30291acc59bf0f7b5dac49c98c375. after waiting 0 ms 2023-07-21 10:14:58,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689934480849.e6c30291acc59bf0f7b5dac49c98c375. 2023-07-21 10:14:58,528 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 3e361bfa6fa27b2c41a2d8979f4679fe 2023-07-21 10:14:58,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 3e361bfa6fa27b2c41a2d8979f4679fe, disabling compactions & flushes 2023-07-21 10:14:58,529 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689934480849.3e361bfa6fa27b2c41a2d8979f4679fe. 2023-07-21 10:14:58,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689934480849.3e361bfa6fa27b2c41a2d8979f4679fe. 2023-07-21 10:14:58,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689934480849.3e361bfa6fa27b2c41a2d8979f4679fe. after waiting 0 ms 2023-07-21 10:14:58,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689934480849.3e361bfa6fa27b2c41a2d8979f4679fe. 2023-07-21 10:14:58,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testEmptyExportFileSystemState/e6c30291acc59bf0f7b5dac49c98c375/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 10:14:58,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:14:58,637 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689934480849.e6c30291acc59bf0f7b5dac49c98c375. 2023-07-21 10:14:58,637 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for e6c30291acc59bf0f7b5dac49c98c375: 2023-07-21 10:14:58,640 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed e6c30291acc59bf0f7b5dac49c98c375 2023-07-21 10:14:58,640 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=e6c30291acc59bf0f7b5dac49c98c375, regionState=CLOSED 2023-07-21 10:14:58,640 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689934480849.e6c30291acc59bf0f7b5dac49c98c375.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689934498640"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934498640"}]},"ts":"1689934498640"} 2023-07-21 10:14:58,644 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testEmptyExportFileSystemState/3e361bfa6fa27b2c41a2d8979f4679fe/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 10:14:58,644 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:14:58,658 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689934480849.3e361bfa6fa27b2c41a2d8979f4679fe. 2023-07-21 10:14:58,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 3e361bfa6fa27b2c41a2d8979f4679fe: 2023-07-21 10:14:58,661 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 3e361bfa6fa27b2c41a2d8979f4679fe 2023-07-21 10:14:58,662 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-21 10:14:58,662 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure e6c30291acc59bf0f7b5dac49c98c375, server=jenkins-hbase17.apache.org,37151,1689934329015 in 277 msec 2023-07-21 10:14:58,663 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=3e361bfa6fa27b2c41a2d8979f4679fe, regionState=CLOSED 2023-07-21 10:14:58,663 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689934480849.3e361bfa6fa27b2c41a2d8979f4679fe.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689934498663"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934498663"}]},"ts":"1689934498663"} 2023-07-21 10:14:58,669 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=e6c30291acc59bf0f7b5dac49c98c375, UNASSIGN in 298 msec 2023-07-21 10:14:58,669 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-21 10:14:58,669 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 3e361bfa6fa27b2c41a2d8979f4679fe, server=jenkins-hbase17.apache.org,36809,1689934328937 in 291 msec 2023-07-21 10:14:58,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-21 10:14:58,690 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-21 10:14:58,690 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3e361bfa6fa27b2c41a2d8979f4679fe, UNASSIGN in 305 msec 2023-07-21 10:14:58,692 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934498692"}]},"ts":"1689934498692"} 2023-07-21 10:14:58,711 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-21 10:14:58,718 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-21 10:14:58,720 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 370 msec 2023-07-21 10:14:58,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-21 10:14:58,973 INFO [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-21 10:14:58,974 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testEmptyExportFileSystemState 2023-07-21 10:14:58,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 10:14:58,978 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 10:14:58,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-21 10:14:58,979 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 10:14:58,980 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37151] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-21 10:14:58,982 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-21 10:14:58,982 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-21 10:14:58,982 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-21 10:14:58,982 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-21 10:14:58,983 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-21 10:14:58,983 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-21 10:14:58,983 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:58,983 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:58,984 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-21 10:14:58,984 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:58,984 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-21 10:14:58,984 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-21 10:14:58,984 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-21 10:14:58,984 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-21 10:14:58,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-21 10:14:58,991 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-21 10:14:58,991 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:58,992 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testEmptyExportFileSystemState/3e361bfa6fa27b2c41a2d8979f4679fe 2023-07-21 10:14:58,995 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testEmptyExportFileSystemState/3e361bfa6fa27b2c41a2d8979f4679fe/cf, FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testEmptyExportFileSystemState/3e361bfa6fa27b2c41a2d8979f4679fe/recovered.edits] 2023-07-21 10:14:58,995 DEBUG [HFileArchiver-26] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testEmptyExportFileSystemState/e6c30291acc59bf0f7b5dac49c98c375 2023-07-21 10:14:59,003 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testEmptyExportFileSystemState/3e361bfa6fa27b2c41a2d8979f4679fe/cf/ceeede4a03ea4bba837640de12887365 to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/archive/data/default/testtb-testEmptyExportFileSystemState/3e361bfa6fa27b2c41a2d8979f4679fe/cf/ceeede4a03ea4bba837640de12887365 2023-07-21 10:14:59,017 DEBUG [HFileArchiver-26] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testEmptyExportFileSystemState/e6c30291acc59bf0f7b5dac49c98c375/cf, FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testEmptyExportFileSystemState/e6c30291acc59bf0f7b5dac49c98c375/recovered.edits] 2023-07-21 10:14:59,028 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testEmptyExportFileSystemState/3e361bfa6fa27b2c41a2d8979f4679fe/recovered.edits/9.seqid to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/archive/data/default/testtb-testEmptyExportFileSystemState/3e361bfa6fa27b2c41a2d8979f4679fe/recovered.edits/9.seqid 2023-07-21 10:14:59,029 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testEmptyExportFileSystemState/3e361bfa6fa27b2c41a2d8979f4679fe 2023-07-21 10:14:59,035 DEBUG [HFileArchiver-26] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testEmptyExportFileSystemState/e6c30291acc59bf0f7b5dac49c98c375/cf/affd37d4f4e04ec68ce074fe20ade9af to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/archive/data/default/testtb-testEmptyExportFileSystemState/e6c30291acc59bf0f7b5dac49c98c375/cf/affd37d4f4e04ec68ce074fe20ade9af 2023-07-21 10:14:59,049 DEBUG [HFileArchiver-26] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testEmptyExportFileSystemState/e6c30291acc59bf0f7b5dac49c98c375/recovered.edits/9.seqid to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/archive/data/default/testtb-testEmptyExportFileSystemState/e6c30291acc59bf0f7b5dac49c98c375/recovered.edits/9.seqid 2023-07-21 10:14:59,050 DEBUG [HFileArchiver-26] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testEmptyExportFileSystemState/e6c30291acc59bf0f7b5dac49c98c375 2023-07-21 10:14:59,050 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-21 10:14:59,050 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-21 10:14:59,052 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-21 10:14:59,057 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307214d9810e48ef6495dba199a9973c60f6a to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307214d9810e48ef6495dba199a9973c60f6a 2023-07-21 10:14:59,066 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307215c31420662d044d5afc78f07ece02095 to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307215c31420662d044d5afc78f07ece02095 2023-07-21 10:14:59,067 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-21 10:14:59,071 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 10:14:59,077 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-21 10:14:59,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-21 10:14:59,104 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-21 10:14:59,108 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 10:14:59,108 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-21 10:14:59,109 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689934480849.e6c30291acc59bf0f7b5dac49c98c375.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689934499108"}]},"ts":"9223372036854775807"} 2023-07-21 10:14:59,109 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689934480849.3e361bfa6fa27b2c41a2d8979f4679fe.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689934499108"}]},"ts":"9223372036854775807"} 2023-07-21 10:14:59,122 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-21 10:14:59,122 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e6c30291acc59bf0f7b5dac49c98c375, NAME => 'testtb-testEmptyExportFileSystemState,,1689934480849.e6c30291acc59bf0f7b5dac49c98c375.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 3e361bfa6fa27b2c41a2d8979f4679fe, NAME => 'testtb-testEmptyExportFileSystemState,1,1689934480849.3e361bfa6fa27b2c41a2d8979f4679fe.', STARTKEY => '1', ENDKEY => ''}] 2023-07-21 10:14:59,122 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-21 10:14:59,122 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689934499122"}]},"ts":"9223372036854775807"} 2023-07-21 10:14:59,144 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-21 10:14:59,159 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 10:14:59,172 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 185 msec 2023-07-21 10:14:59,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-21 10:14:59,292 INFO [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-21 10:14:59,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-21 10:14:59,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:59,322 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-21 10:14:59,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:59,363 INFO [Listener at jenkins-hbase17.apache.org/42227] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=762 (was 750) Potentially hanging thread: IPC Client (804182503) connection to jenkins-hbase17.apache.org/136.243.18.41:40209 from appattempt_1689934340509_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1bf23fcf-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (804182503) connection to jenkins-hbase17.apache.org/136.243.18.41:46859 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x1bf23fcf-shared-pool-46 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1557406679_17 at /127.0.0.1:57440 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1bf23fcf-shared-pool-47 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1631912850_1 at /127.0.0.1:44698 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1557406679_17 at /127.0.0.1:43356 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4799 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-26 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1bf23fcf-shared-pool-48 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #2 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-24 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (804182503) connection to jenkins-hbase17.apache.org/136.243.18.41:42227 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1557406679_17 at /127.0.0.1:46170 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-25 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=904 (was 895) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1504 (was 1602), ProcessCount=194 (was 193) - ProcessCount LEAK? -, AvailableMemoryMB=1444 (was 1638) 2023-07-21 10:14:59,364 WARN [Listener at jenkins-hbase17.apache.org/42227] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-21 10:14:59,394 INFO [Listener at jenkins-hbase17.apache.org/42227] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=762, OpenFileDescriptor=904, MaxFileDescriptor=60000, SystemLoadAverage=1504, ProcessCount=194, AvailableMemoryMB=1442 2023-07-21 10:14:59,394 WARN [Listener at jenkins-hbase17.apache.org/42227] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-21 10:14:59,397 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-21 10:14:59,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:59,409 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 10:14:59,410 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-21 10:14:59,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-21 10:14:59,413 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 10:14:59,418 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/31fbc556402ce3039b2616a61d7e41d1 2023-07-21 10:14:59,418 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f800e06e096f85958fdb4fd2d039b84b 2023-07-21 10:14:59,419 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/31fbc556402ce3039b2616a61d7e41d1 empty. 2023-07-21 10:14:59,423 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/31fbc556402ce3039b2616a61d7e41d1 2023-07-21 10:14:59,423 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f800e06e096f85958fdb4fd2d039b84b empty. 2023-07-21 10:14:59,426 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f800e06e096f85958fdb4fd2d039b84b 2023-07-21 10:14:59,426 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-21 10:14:59,513 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-21 10:14:59,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-21 10:14:59,525 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => f800e06e096f85958fdb4fd2d039b84b, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689934499397.f800e06e096f85958fdb4fd2d039b84b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp 2023-07-21 10:14:59,540 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 31fbc556402ce3039b2616a61d7e41d1, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689934499397.31fbc556402ce3039b2616a61d7e41d1.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp 2023-07-21 10:14:59,631 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689934499397.31fbc556402ce3039b2616a61d7e41d1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:14:59,631 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 31fbc556402ce3039b2616a61d7e41d1, disabling compactions & flushes 2023-07-21 10:14:59,631 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689934499397.31fbc556402ce3039b2616a61d7e41d1. 2023-07-21 10:14:59,631 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689934499397.31fbc556402ce3039b2616a61d7e41d1. 2023-07-21 10:14:59,631 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689934499397.31fbc556402ce3039b2616a61d7e41d1. after waiting 0 ms 2023-07-21 10:14:59,632 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689934499397.31fbc556402ce3039b2616a61d7e41d1. 2023-07-21 10:14:59,632 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689934499397.31fbc556402ce3039b2616a61d7e41d1. 2023-07-21 10:14:59,632 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 31fbc556402ce3039b2616a61d7e41d1: 2023-07-21 10:14:59,639 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689934499397.f800e06e096f85958fdb4fd2d039b84b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:14:59,640 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing f800e06e096f85958fdb4fd2d039b84b, disabling compactions & flushes 2023-07-21 10:14:59,640 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689934499397.f800e06e096f85958fdb4fd2d039b84b. 2023-07-21 10:14:59,640 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689934499397.f800e06e096f85958fdb4fd2d039b84b. 2023-07-21 10:14:59,640 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689934499397.f800e06e096f85958fdb4fd2d039b84b. after waiting 0 ms 2023-07-21 10:14:59,640 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689934499397.f800e06e096f85958fdb4fd2d039b84b. 2023-07-21 10:14:59,640 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689934499397.f800e06e096f85958fdb4fd2d039b84b. 2023-07-21 10:14:59,640 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for f800e06e096f85958fdb4fd2d039b84b: 2023-07-21 10:14:59,662 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 10:14:59,663 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689934499397.31fbc556402ce3039b2616a61d7e41d1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689934499663"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934499663"}]},"ts":"1689934499663"} 2023-07-21 10:14:59,664 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689934499397.f800e06e096f85958fdb4fd2d039b84b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689934499663"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934499663"}]},"ts":"1689934499663"} 2023-07-21 10:14:59,676 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-21 10:14:59,677 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 10:14:59,677 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934499677"}]},"ts":"1689934499677"} 2023-07-21 10:14:59,678 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-21 10:14:59,680 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-21 10:14:59,684 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 10:14:59,684 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 10:14:59,684 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 10:14:59,684 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 10:14:59,685 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f800e06e096f85958fdb4fd2d039b84b, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=31fbc556402ce3039b2616a61d7e41d1, ASSIGN}] 2023-07-21 10:14:59,697 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=31fbc556402ce3039b2616a61d7e41d1, ASSIGN 2023-07-21 10:14:59,697 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f800e06e096f85958fdb4fd2d039b84b, ASSIGN 2023-07-21 10:14:59,702 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=31fbc556402ce3039b2616a61d7e41d1, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,36809,1689934328937; forceNewPlan=false, retain=false 2023-07-21 10:14:59,702 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f800e06e096f85958fdb4fd2d039b84b, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,37151,1689934329015; forceNewPlan=false, retain=false 2023-07-21 10:14:59,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-21 10:14:59,853 INFO [jenkins-hbase17:35385] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-21 10:14:59,857 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=f800e06e096f85958fdb4fd2d039b84b, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:14:59,857 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689934499397.f800e06e096f85958fdb4fd2d039b84b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689934499857"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934499857"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934499857"}]},"ts":"1689934499857"} 2023-07-21 10:14:59,858 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=31fbc556402ce3039b2616a61d7e41d1, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:14:59,858 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689934499397.31fbc556402ce3039b2616a61d7e41d1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689934499858"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934499858"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934499858"}]},"ts":"1689934499858"} 2023-07-21 10:14:59,863 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure f800e06e096f85958fdb4fd2d039b84b, server=jenkins-hbase17.apache.org,37151,1689934329015}] 2023-07-21 10:14:59,864 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 31fbc556402ce3039b2616a61d7e41d1, server=jenkins-hbase17.apache.org,36809,1689934328937}] 2023-07-21 10:15:00,019 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689934499397.31fbc556402ce3039b2616a61d7e41d1. 2023-07-21 10:15:00,019 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689934499397.f800e06e096f85958fdb4fd2d039b84b. 2023-07-21 10:15:00,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 31fbc556402ce3039b2616a61d7e41d1, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689934499397.31fbc556402ce3039b2616a61d7e41d1.', STARTKEY => '1', ENDKEY => ''} 2023-07-21 10:15:00,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689934499397.31fbc556402ce3039b2616a61d7e41d1. service=AccessControlService 2023-07-21 10:15:00,020 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:15:00,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 31fbc556402ce3039b2616a61d7e41d1 2023-07-21 10:15:00,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689934499397.31fbc556402ce3039b2616a61d7e41d1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:15:00,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 31fbc556402ce3039b2616a61d7e41d1 2023-07-21 10:15:00,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 31fbc556402ce3039b2616a61d7e41d1 2023-07-21 10:15:00,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f800e06e096f85958fdb4fd2d039b84b, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689934499397.f800e06e096f85958fdb4fd2d039b84b.', STARTKEY => '', ENDKEY => '1'} 2023-07-21 10:15:00,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689934499397.f800e06e096f85958fdb4fd2d039b84b. service=AccessControlService 2023-07-21 10:15:00,021 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:15:00,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp f800e06e096f85958fdb4fd2d039b84b 2023-07-21 10:15:00,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689934499397.f800e06e096f85958fdb4fd2d039b84b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:15:00,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for f800e06e096f85958fdb4fd2d039b84b 2023-07-21 10:15:00,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for f800e06e096f85958fdb4fd2d039b84b 2023-07-21 10:15:00,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-21 10:15:00,028 INFO [StoreOpener-f800e06e096f85958fdb4fd2d039b84b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f800e06e096f85958fdb4fd2d039b84b 2023-07-21 10:15:00,029 INFO [StoreOpener-31fbc556402ce3039b2616a61d7e41d1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 31fbc556402ce3039b2616a61d7e41d1 2023-07-21 10:15:00,033 DEBUG [StoreOpener-f800e06e096f85958fdb4fd2d039b84b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithSkipTmp/f800e06e096f85958fdb4fd2d039b84b/cf 2023-07-21 10:15:00,034 DEBUG [StoreOpener-f800e06e096f85958fdb4fd2d039b84b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithSkipTmp/f800e06e096f85958fdb4fd2d039b84b/cf 2023-07-21 10:15:00,034 INFO [StoreOpener-f800e06e096f85958fdb4fd2d039b84b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f800e06e096f85958fdb4fd2d039b84b columnFamilyName cf 2023-07-21 10:15:00,035 DEBUG [StoreOpener-31fbc556402ce3039b2616a61d7e41d1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithSkipTmp/31fbc556402ce3039b2616a61d7e41d1/cf 2023-07-21 10:15:00,035 DEBUG [StoreOpener-31fbc556402ce3039b2616a61d7e41d1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithSkipTmp/31fbc556402ce3039b2616a61d7e41d1/cf 2023-07-21 10:15:00,035 INFO [StoreOpener-31fbc556402ce3039b2616a61d7e41d1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 31fbc556402ce3039b2616a61d7e41d1 columnFamilyName cf 2023-07-21 10:15:00,039 INFO [StoreOpener-31fbc556402ce3039b2616a61d7e41d1-1] regionserver.HStore(310): Store=31fbc556402ce3039b2616a61d7e41d1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:15:00,041 INFO [StoreOpener-f800e06e096f85958fdb4fd2d039b84b-1] regionserver.HStore(310): Store=f800e06e096f85958fdb4fd2d039b84b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:15:00,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithSkipTmp/f800e06e096f85958fdb4fd2d039b84b 2023-07-21 10:15:00,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithSkipTmp/f800e06e096f85958fdb4fd2d039b84b 2023-07-21 10:15:00,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithSkipTmp/31fbc556402ce3039b2616a61d7e41d1 2023-07-21 10:15:00,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithSkipTmp/31fbc556402ce3039b2616a61d7e41d1 2023-07-21 10:15:00,046 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for f800e06e096f85958fdb4fd2d039b84b 2023-07-21 10:15:00,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 31fbc556402ce3039b2616a61d7e41d1 2023-07-21 10:15:00,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithSkipTmp/f800e06e096f85958fdb4fd2d039b84b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 10:15:00,050 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened f800e06e096f85958fdb4fd2d039b84b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61101115, jitterRate=-0.08952243626117706}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 10:15:00,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for f800e06e096f85958fdb4fd2d039b84b: 2023-07-21 10:15:00,055 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689934499397.f800e06e096f85958fdb4fd2d039b84b., pid=108, masterSystemTime=1689934500016 2023-07-21 10:15:00,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689934499397.f800e06e096f85958fdb4fd2d039b84b. 2023-07-21 10:15:00,059 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689934499397.f800e06e096f85958fdb4fd2d039b84b. 2023-07-21 10:15:00,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithSkipTmp/31fbc556402ce3039b2616a61d7e41d1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 10:15:00,061 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=f800e06e096f85958fdb4fd2d039b84b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:00,061 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689934499397.f800e06e096f85958fdb4fd2d039b84b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689934500061"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689934500061"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689934500061"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689934500061"}]},"ts":"1689934500061"} 2023-07-21 10:15:00,062 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 31fbc556402ce3039b2616a61d7e41d1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61468325, jitterRate=-0.08405058085918427}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 10:15:00,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 31fbc556402ce3039b2616a61d7e41d1: 2023-07-21 10:15:00,076 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689934499397.31fbc556402ce3039b2616a61d7e41d1., pid=109, masterSystemTime=1689934500016 2023-07-21 10:15:00,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689934499397.31fbc556402ce3039b2616a61d7e41d1. 2023-07-21 10:15:00,082 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689934499397.31fbc556402ce3039b2616a61d7e41d1. 2023-07-21 10:15:00,083 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-21 10:15:00,083 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=31fbc556402ce3039b2616a61d7e41d1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:00,083 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure f800e06e096f85958fdb4fd2d039b84b, server=jenkins-hbase17.apache.org,37151,1689934329015 in 206 msec 2023-07-21 10:15:00,084 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689934499397.31fbc556402ce3039b2616a61d7e41d1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689934500083"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689934500083"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689934500083"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689934500083"}]},"ts":"1689934500083"} 2023-07-21 10:15:00,087 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f800e06e096f85958fdb4fd2d039b84b, ASSIGN in 399 msec 2023-07-21 10:15:00,091 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-21 10:15:00,091 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 31fbc556402ce3039b2616a61d7e41d1, server=jenkins-hbase17.apache.org,36809,1689934328937 in 223 msec 2023-07-21 10:15:00,094 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-21 10:15:00,094 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=31fbc556402ce3039b2616a61d7e41d1, ASSIGN in 406 msec 2023-07-21 10:15:00,095 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 10:15:00,095 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934500095"}]},"ts":"1689934500095"} 2023-07-21 10:15:00,097 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-21 10:15:00,103 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 10:15:00,103 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-21 10:15:00,105 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37151] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-21 10:15:00,109 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:15:00,109 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:15:00,109 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:15:00,109 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:15:00,110 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-21 10:15:00,110 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-21 10:15:00,110 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-21 10:15:00,110 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-21 10:15:00,111 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 713 msec 2023-07-21 10:15:00,487 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-21 10:15:00,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-21 10:15:00,525 INFO [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-21 10:15:00,527 DEBUG [Listener at jenkins-hbase17.apache.org/42227] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,527 DEBUG [Listener at jenkins-hbase17.apache.org/42227] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689934499397.f800e06e096f85958fdb4fd2d039b84b. 2023-07-21 10:15:00,529 INFO [Listener at jenkins-hbase17.apache.org/42227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 10:15:00,547 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-21 10:15:00,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689934500547 (current time:1689934500547). 2023-07-21 10:15:00,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 10:15:00,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] zookeeper.ReadOnlyZKClient(139): Connect 0x7c39ff37 to 127.0.0.1:56971 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:15:00,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@437941d3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:15:00,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:15:00,564 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:48344, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:15:00,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c39ff37 to 127.0.0.1:56971 2023-07-21 10:15:00,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:15:00,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] zookeeper.ReadOnlyZKClient(139): Connect 0x66afa761 to 127.0.0.1:56971 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:15:00,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@55dc2cc4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:15:00,674 DEBUG [hconnection-0x5ca29875-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:15:00,679 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:48358, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:15:00,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:15:00,689 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:49918, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:15:00,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66afa761 to 127.0.0.1:56971 2023-07-21 10:15:00,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:15:00,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-21 10:15:00,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 10:15:00,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-21 10:15:00,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-21 10:15:00,700 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-21 10:15:00,702 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689935100702 2023-07-21 10:15:00,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-21 10:15:00,702 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,705 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-21 10:15:00,705 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 10:15:00,705 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 10:15:00,705 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-21 10:15:00,706 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 11 msec 2023-07-21 10:15:00,708 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-21 10:15:00,712 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689935100712 2023-07-21 10:15:00,724 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,724 INFO [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-21 10:15:00,724 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:15:00,726 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-21 10:15:00,726 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-21 10:15:00,727 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,727 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,730 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:15:00,730 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:15:00,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:15:00,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:15:00,730 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:00,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:15:00,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:15:00,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,731 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:00,731 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:00,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,731 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,731 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:00,731 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 10:15:00,731 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-21 10:15:00,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-21 10:15:00,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,732 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-21 10:15:00,732 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-21 10:15:00,732 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:15:00,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:15:00,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:15:00,732 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,732 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-21 10:15:00,732 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:15:00,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,733 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,733 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-21 10:15:00,738 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:15:00,737 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-21 10:15:00,738 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-21 10:15:00,738 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36809,1689934328937' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-21 10:15:00,738 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-21 10:15:00,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,740 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-21 10:15:00,740 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-21 10:15:00,740 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,37151,1689934329015' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-21 10:15:00,740 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-21 10:15:00,741 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,741 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-21 10:15:00,741 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:15:00,741 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,742 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:00,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:00,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:15:00,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:15:00,742 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,742 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:15:00,742 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:00,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:15:00,743 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:15:00,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,744 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,744 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:15:00,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:00,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:00,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:15:00,745 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,36809,1689934328937' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-21 10:15:00,745 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@561905f8[Count = 1] remaining members to acquire global barrier 2023-07-21 10:15:00,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:00,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:15:00,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:15:00,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:15:00,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:15:00,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:00,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:00,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:15:00,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,37151,1689934329015' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-21 10:15:00,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@561905f8[Count = 0] remaining members to acquire global barrier 2023-07-21 10:15:00,747 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-21 10:15:00,747 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,748 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,748 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,748 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-21 10:15:00,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,748 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-21 10:15:00,748 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:00,749 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:00,749 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 10:15:00,752 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:15:00,764 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:15:00,764 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:15:00,758 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-21 10:15:00,767 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-21 10:15:00,767 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,38751,1689934329069' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-21 10:15:00,768 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,768 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689934499397.f800e06e096f85958fdb4fd2d039b84b. 2023-07-21 10:15:00,768 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] zookeeper.ZKUtil(162): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,768 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,768 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:15:00,768 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-21 10:15:00,768 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-21 10:15:00,768 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,38751,1689934329069' in zk 2023-07-21 10:15:00,771 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-21 10:15:00,771 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:15:00,771 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-21 10:15:00,759 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689934499397.31fbc556402ce3039b2616a61d7e41d1. 2023-07-21 10:15:00,768 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689934499397.f800e06e096f85958fdb4fd2d039b84b. started... 2023-07-21 10:15:00,764 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:15:00,776 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689934499397.31fbc556402ce3039b2616a61d7e41d1. started... 2023-07-21 10:15:00,776 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f800e06e096f85958fdb4fd2d039b84b: 2023-07-21 10:15:00,778 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 31fbc556402ce3039b2616a61d7e41d1: 2023-07-21 10:15:00,778 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689934499397.f800e06e096f85958fdb4fd2d039b84b.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,778 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:15:00,778 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 10:15:00,778 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689934499397.31fbc556402ce3039b2616a61d7e41d1.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,778 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:15:00,778 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 10:15:00,814 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:15:00,815 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689934499397.31fbc556402ce3039b2616a61d7e41d1. completed. 2023-07-21 10:15:00,815 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689934499397.31fbc556402ce3039b2616a61d7e41d1. 2023-07-21 10:15:00,815 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:15:00,815 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:15:00,815 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:00,815 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-21 10:15:00,815 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,36809,1689934328937' in zk 2023-07-21 10:15:00,817 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-21 10:15:00,817 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:00,817 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:15:00,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:00,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:15:00,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:15:00,817 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-21 10:15:00,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:15:00,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:15:00,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:00,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:15:00,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:00,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:15:00,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 10:15:00,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:15:00,821 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 10:15:00,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:15:00,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:00,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase17.apache.org,36809,1689934328937': 2023-07-21 10:15:00,821 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,36809,1689934328937' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-21 10:15:01,021 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:15:01,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 10:15:01,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:15:01,022 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 10:15:01,218 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689934499397.f800e06e096f85958fdb4fd2d039b84b. completed. 2023-07-21 10:15:01,218 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689934499397.f800e06e096f85958fdb4fd2d039b84b. 2023-07-21 10:15:01,219 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:15:01,219 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:15:01,219 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:01,220 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-21 10:15:01,220 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,37151,1689934329015' in zk 2023-07-21 10:15:01,222 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:01,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:01,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:15:01,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:15:01,222 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-21 10:15:01,222 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:15:01,222 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-21 10:15:01,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:15:01,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:15:01,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:01,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:15:01,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:01,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:15:01,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:01,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:15:01,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:01,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase17.apache.org,37151,1689934329015': 2023-07-21 10:15:01,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,37151,1689934329015' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-21 10:15:01,228 INFO [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-21 10:15:01,228 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 10:15:01,228 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 10:15:01,228 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,228 INFO [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 10:15:01,229 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,229 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:15:01,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:15:01,229 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,229 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,230 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:15:01,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,229 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:15:01,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,230 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:15:01,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,230 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:01,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:15:01,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:15:01,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:15:01,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:15:01,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:15:01,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:15:01,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:15:01,230 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:15:01,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,231 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:01,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:15:01,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:01,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:15:01,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:01,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:15:01,232 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:01,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,236 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:15:01,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:01,237 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:01,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:15:01,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:01,322 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:15:01,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 10:15:01,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:15:01,323 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-21 10:15:01,477 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:15:01,477 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:15:01,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:15:01,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:15:01,477 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:15:01,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:15:01,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:15:01,477 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,477 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:01,477 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,477 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:15:01,477 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:15:01,477 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:01,479 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,479 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:01,479 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,479 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:15:01,479 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:01,479 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,479 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,479 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:15:01,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:15:01,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:15:01,479 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,479 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,479 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,479 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-21 10:15:01,479 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:15:01,480 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-21 10:15:01,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:15:01,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:15:01,488 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:15:01,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:15:01,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:15:01,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:15:01,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:15:01,522 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,524 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,644 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,823 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:15:01,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 10:15:01,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:15:01,826 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-21 10:15:01,832 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-21 10:15:01,832 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,833 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,834 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689934500702Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689934501522 (+820 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689934501522Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689934501523 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689934501542 (+19 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689934501611 (+69 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689934501832 (+221 ms) 2023-07-21 10:15:01,846 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-21 10:15:01,859 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 1.1420 sec 2023-07-21 10:15:02,826 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:15:02,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 10:15:02,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 10:15:02,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36809] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689934499397.31fbc556402ce3039b2616a61d7e41d1. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 10:15:02,837 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37151] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689934499397.f800e06e096f85958fdb4fd2d039b84b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 10:15:02,854 DEBUG [Listener at jenkins-hbase17.apache.org/42227] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:02,855 DEBUG [Listener at jenkins-hbase17.apache.org/42227] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689934499397.f800e06e096f85958fdb4fd2d039b84b. 2023-07-21 10:15:02,855 INFO [Listener at jenkins-hbase17.apache.org/42227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 10:15:02,867 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-21 10:15:02,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689934502867 (current time:1689934502867). 2023-07-21 10:15:02,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 10:15:02,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] zookeeper.ReadOnlyZKClient(139): Connect 0x72b0d5b4 to 127.0.0.1:56971 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:15:02,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a199aa7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:15:02,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:15:02,900 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:48362, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:15:02,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x72b0d5b4 to 127.0.0.1:56971 2023-07-21 10:15:02,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:15:02,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] zookeeper.ReadOnlyZKClient(139): Connect 0x58f7fcd8 to 127.0.0.1:56971 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:15:02,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2c9e9f07, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:15:02,920 DEBUG [hconnection-0x5aa4f491-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:15:02,925 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:48372, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:15:02,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:15:02,936 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:49924, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:15:02,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58f7fcd8 to 127.0.0.1:56971 2023-07-21 10:15:02,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:15:02,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-21 10:15:02,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 10:15:02,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-21 10:15:02,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-21 10:15:02,947 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-21 10:15:02,948 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689935102948 2023-07-21 10:15:02,949 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:02,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-21 10:15:02,951 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 10:15:02,951 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 10:15:02,952 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-21 10:15:02,954 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-21 10:15:02,956 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 11 msec 2023-07-21 10:15:02,957 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-21 10:15:02,958 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689935102958 2023-07-21 10:15:03,052 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:15:03,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 10:15:03,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:15:03,053 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 10:15:03,253 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:15:03,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 10:15:03,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:15:03,254 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 10:15:03,383 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:03,386 INFO [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-21 10:15:03,387 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:15:03,387 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-21 10:15:03,387 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-21 10:15:03,388 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:03,388 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:03,389 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:15:03,389 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:15:03,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:15:03,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:15:03,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:15:03,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:15:03,389 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:15:03,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:15:03,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:15:03,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:03,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:03,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:03,391 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:03,391 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:03,391 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:03,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-21 10:15:03,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-21 10:15:03,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:03,391 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-21 10:15:03,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-21 10:15:03,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:03,392 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-21 10:15:03,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:03,392 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-21 10:15:03,392 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:03,393 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:03,394 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:03,394 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:03,394 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 10:15:03,395 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:03,395 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-21 10:15:03,395 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:15:03,396 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:03,397 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:03,397 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-21 10:15:03,397 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:15:03,398 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-21 10:15:03,398 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:15:03,401 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-21 10:15:03,402 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-21 10:15:03,402 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,37151,1689934329015' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-21 10:15:03,402 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-21 10:15:03,402 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-21 10:15:03,402 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,36809,1689934328937' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-21 10:15:03,404 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:03,404 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:03,404 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-21 10:15:03,404 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-21 10:15:03,404 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,38751,1689934329069' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-21 10:15:03,405 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:03,406 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:15:03,406 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:03,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:03,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:15:03,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:15:03,406 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:03,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:15:03,407 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:03,407 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:15:03,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:15:03,423 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:03,424 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934340509_0006_000001 (auth:SIMPLE) 2023-07-21 10:15:03,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:03,429 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:03,429 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:15:03,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:03,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:15:03,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:03,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:15:03,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,37151,1689934329015' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-21 10:15:03,438 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26f6a4aa[Count = 1] remaining members to acquire global barrier 2023-07-21 10:15:03,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:03,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:15:03,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:15:03,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:15:03,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:15:03,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:03,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:03,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:15:03,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:03,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:15:03,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,36809,1689934328937' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-21 10:15:03,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26f6a4aa[Count = 0] remaining members to acquire global barrier 2023-07-21 10:15:03,443 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-21 10:15:03,443 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:03,444 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:03,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:03,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:03,445 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:03,445 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:03,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:03,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:03,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:03,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:03,445 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-21 10:15:03,445 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-21 10:15:03,445 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,38751,1689934329069' in zk 2023-07-21 10:15:03,445 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-21 10:15:03,445 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-21 10:15:03,446 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:15:03,446 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:15:03,446 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-21 10:15:03,446 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:15:03,446 DEBUG [member: 'jenkins-hbase17.apache.org,38751,1689934329069' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-21 10:15:03,447 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:03,447 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689934499397.31fbc556402ce3039b2616a61d7e41d1. 2023-07-21 10:15:03,450 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689934499397.f800e06e096f85958fdb4fd2d039b84b. 2023-07-21 10:15:03,450 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689934499397.f800e06e096f85958fdb4fd2d039b84b. started... 2023-07-21 10:15:03,450 INFO [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f800e06e096f85958fdb4fd2d039b84b 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-21 10:15:03,447 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:15:03,451 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:15:03,447 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:03,451 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 10:15:03,450 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689934499397.31fbc556402ce3039b2616a61d7e41d1. started... 2023-07-21 10:15:03,451 INFO [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 31fbc556402ce3039b2616a61d7e41d1 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-21 10:15:03,539 INFO [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230721485e4daeedcc4f6caea30c8e545f72e9 to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230721485e4daeedcc4f6caea30c8e545f72e9 2023-07-21 10:15:03,554 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:15:03,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 10:15:03,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:15:03,556 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-21 10:15:03,585 INFO [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithSkipTmp/f800e06e096f85958fdb4fd2d039b84b/.tmp/cf/f806fdecf401481d996cc08d26a4b241 2023-07-21 10:15:03,598 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithSkipTmp/f800e06e096f85958fdb4fd2d039b84b/.tmp/cf/f806fdecf401481d996cc08d26a4b241 as hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithSkipTmp/f800e06e096f85958fdb4fd2d039b84b/cf/f806fdecf401481d996cc08d26a4b241 2023-07-21 10:15:03,605 INFO [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithSkipTmp/f800e06e096f85958fdb4fd2d039b84b/cf/f806fdecf401481d996cc08d26a4b241, entries=2, sequenceid=6, filesize=5.2 K 2023-07-21 10:15:03,606 INFO [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for f800e06e096f85958fdb4fd2d039b84b in 156ms, sequenceid=6, compaction requested=false 2023-07-21 10:15:03,608 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f800e06e096f85958fdb4fd2d039b84b: 2023-07-21 10:15:03,608 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689934499397.f800e06e096f85958fdb4fd2d039b84b.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:03,608 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:15:03,608 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithSkipTmp/f800e06e096f85958fdb4fd2d039b84b/cf/f806fdecf401481d996cc08d26a4b241] hfiles 2023-07-21 10:15:03,608 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithSkipTmp/f800e06e096f85958fdb4fd2d039b84b/cf/f806fdecf401481d996cc08d26a4b241 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:03,936 INFO [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023072156cc3ec5ef7c4856bf4c11ad3d7ebd9d to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023072156cc3ec5ef7c4856bf4c11ad3d7ebd9d 2023-07-21 10:15:03,985 INFO [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithSkipTmp/31fbc556402ce3039b2616a61d7e41d1/.tmp/cf/701266a918e44c97bb4917cd39264a8b 2023-07-21 10:15:03,998 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithSkipTmp/31fbc556402ce3039b2616a61d7e41d1/.tmp/cf/701266a918e44c97bb4917cd39264a8b as hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithSkipTmp/31fbc556402ce3039b2616a61d7e41d1/cf/701266a918e44c97bb4917cd39264a8b 2023-07-21 10:15:04,004 INFO [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithSkipTmp/31fbc556402ce3039b2616a61d7e41d1/cf/701266a918e44c97bb4917cd39264a8b, entries=48, sequenceid=6, filesize=13.5 K 2023-07-21 10:15:04,024 INFO [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 31fbc556402ce3039b2616a61d7e41d1 in 573ms, sequenceid=6, compaction requested=false 2023-07-21 10:15:04,024 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 31fbc556402ce3039b2616a61d7e41d1: 2023-07-21 10:15:04,025 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689934499397.31fbc556402ce3039b2616a61d7e41d1.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:04,025 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:15:04,025 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithSkipTmp/31fbc556402ce3039b2616a61d7e41d1/cf/701266a918e44c97bb4917cd39264a8b] hfiles 2023-07-21 10:15:04,025 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithSkipTmp/31fbc556402ce3039b2616a61d7e41d1/cf/701266a918e44c97bb4917cd39264a8b for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:04,030 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689934499397.f800e06e096f85958fdb4fd2d039b84b. completed. 2023-07-21 10:15:04,030 DEBUG [rs(jenkins-hbase17.apache.org,37151,1689934329015)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689934499397.f800e06e096f85958fdb4fd2d039b84b. 2023-07-21 10:15:04,030 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:15:04,030 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:15:04,030 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:04,032 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-21 10:15:04,032 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,37151,1689934329015' in zk 2023-07-21 10:15:04,035 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:04,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:04,035 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-21 10:15:04,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:15:04,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:15:04,035 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:15:04,035 DEBUG [member: 'jenkins-hbase17.apache.org,37151,1689934329015' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-21 10:15:04,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:15:04,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:15:04,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:04,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:04,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:15:04,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:04,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:15:04,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:04,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:04,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:15:04,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase17.apache.org,37151,1689934329015': 2023-07-21 10:15:04,045 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,37151,1689934329015' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-21 10:15:04,053 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689934499397.31fbc556402ce3039b2616a61d7e41d1. completed. 2023-07-21 10:15:04,053 DEBUG [rs(jenkins-hbase17.apache.org,36809,1689934328937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689934499397.31fbc556402ce3039b2616a61d7e41d1. 2023-07-21 10:15:04,053 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:15:04,053 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:15:04,053 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:04,053 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-21 10:15:04,053 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,36809,1689934328937' in zk 2023-07-21 10:15:04,054 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-21 10:15:04,054 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:15:04,054 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:04,054 DEBUG [member: 'jenkins-hbase17.apache.org,36809,1689934328937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-21 10:15:04,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:04,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:15:04,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:15:04,056 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:15:04,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 10:15:04,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:15:04,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:15:04,058 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-21 10:15:04,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:15:04,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:04,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:04,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:15:04,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:04,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:15:04,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:04,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:04,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:15:04,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:04,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase17.apache.org,36809,1689934328937': 2023-07-21 10:15:04,065 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,36809,1689934328937' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-21 10:15:04,065 INFO [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-21 10:15:04,065 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 10:15:04,065 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 10:15:04,065 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:04,065 INFO [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 10:15:04,066 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:04,066 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:04,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:04,066 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:04,066 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:04,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:04,067 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:15:04,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:04,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:04,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:15:04,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:15:04,066 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:15:04,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:04,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:04,067 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:15:04,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:04,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:15:04,067 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:04,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:15:04,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:15:04,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:15:04,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:15:04,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:15:04,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:04,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:04,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:15:04,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:04,072 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:15:04,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:04,072 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:04,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:15:04,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:04,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:04,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:15:04,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:04,077 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:04,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:15:04,077 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:15:04,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:04,078 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:04,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:04,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:15:04,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:04,084 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:15:04,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:15:04,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:15:04,085 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:15:04,085 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:15:04,085 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:15:04,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:15:04,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:15:04,085 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:15:04,085 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:15:04,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:15:04,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:15:04,086 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:04,086 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:04,086 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:15:04,086 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:04,086 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:04,086 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:04,086 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:04,086 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:15:04,086 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:04,086 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:04,086 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:04,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:15:04,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:15:04,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:15:04,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:15:04,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:15:04,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:15:04,087 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:04,087 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:04,087 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:04,088 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-21 10:15:04,087 DEBUG [(jenkins-hbase17.apache.org,35385,1689934327246)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:15:04,091 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023072156cc3ec5ef7c4856bf4c11ad3d7ebd9d, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230721485e4daeedcc4f6caea30c8e545f72e9] mob files 2023-07-21 10:15:04,091 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023072156cc3ec5ef7c4856bf4c11ad3d7ebd9d 2023-07-21 10:15:04,091 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230721485e4daeedcc4f6caea30c8e545f72e9 2023-07-21 10:15:04,158 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:04,158 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:04,238 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 10:15:04,278 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:04,816 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-21 10:15:04,816 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:04,817 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:04,817 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689934502949Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689934504158 (+1209 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689934504158Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689934504158Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689934504180 (+22 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689934504252 (+72 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689934504816 (+564 ms) 2023-07-21 10:15:04,822 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-21 10:15:04,829 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 1.8720 sec 2023-07-21 10:15:05,058 DEBUG [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:15:05,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 10:15:05,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 10:15:05,059 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934505059 2023-07-21 10:15:05,059 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost.localdomain:35937, tgtDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934505059, rawTgtDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934505059, srcFsUri=hdfs://localhost.localdomain:35937, srcDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f 2023-07-21 10:15:05,092 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:35937, inputRoot=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f 2023-07-21 10:15:05,092 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1024201681_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934505059, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934505059/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:05,092 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:35937, inputRoot=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f, snapshotDir=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-21 10:15:05,134 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934505059/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:05,269 WARN [DataStreamer for file /user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934505059/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-21 10:15:05,274 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-21 10:15:05,275 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-21 10:15:05,275 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-21 10:15:05,276 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-21 10:15:05,276 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-21 10:15:05,277 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-21 10:15:05,277 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-21 10:15:05,372 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/hadoop-641605379854762327.jar 2023-07-21 10:15:05,372 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-21 10:15:05,373 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-21 10:15:05,373 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-21 10:15:05,374 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-21 10:15:05,374 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-21 10:15:05,374 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-21 10:15:05,375 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-21 10:15:05,375 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-21 10:15:05,376 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-21 10:15:05,377 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-21 10:15:05,377 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-21 10:15:05,378 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-21 10:15:05,378 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-21 10:15:05,379 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-21 10:15:05,379 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-21 10:15:05,380 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-21 10:15:05,381 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:15:05,382 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:15:05,382 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 10:15:05,382 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:15:05,383 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:15:05,383 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 10:15:05,384 DEBUG [Listener at jenkins-hbase17.apache.org/42227] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 10:15:08,113 WARN [Listener at jenkins-hbase17.apache.org/42227] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-21 10:15:08,118 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-21 10:15:08,120 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-21 10:15:08,221 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 10:15:08,221 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 10:15:08,435 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934340509_0007_000001 (auth:SIMPLE) 2023-07-21 10:15:16,025 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934340509_0007_000001 (auth:SIMPLE) 2023-07-21 10:15:18,339 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934340509_0007_000001 (auth:SIMPLE) 2023-07-21 10:15:21,988 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934340509_0007_000001 (auth:SIMPLE) 2023-07-21 10:15:23,456 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-21 10:15:23,456 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-21 10:15:23,466 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:23,466 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-21 10:15:23,467 INFO [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-21 10:15:23,467 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1557406679_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:23,467 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-21 10:15:23,467 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-21 10:15:23,468 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1557406679_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934505059/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934505059/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:23,468 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934505059/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-21 10:15:23,468 DEBUG [Listener at jenkins-hbase17.apache.org/42227] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/export-test/export-1689934505059/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-21 10:15:23,484 INFO [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:23,485 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:23,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:23,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-21 10:15:23,493 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934523493"}]},"ts":"1689934523493"} 2023-07-21 10:15:23,495 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-21 10:15:23,496 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-21 10:15:23,497 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f800e06e096f85958fdb4fd2d039b84b, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=31fbc556402ce3039b2616a61d7e41d1, UNASSIGN}] 2023-07-21 10:15:23,499 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=31fbc556402ce3039b2616a61d7e41d1, UNASSIGN 2023-07-21 10:15:23,502 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f800e06e096f85958fdb4fd2d039b84b, UNASSIGN 2023-07-21 10:15:23,503 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=31fbc556402ce3039b2616a61d7e41d1, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:23,503 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689934499397.31fbc556402ce3039b2616a61d7e41d1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689934523503"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934523503"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934523503"}]},"ts":"1689934523503"} 2023-07-21 10:15:23,503 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=f800e06e096f85958fdb4fd2d039b84b, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:23,504 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689934499397.f800e06e096f85958fdb4fd2d039b84b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689934523503"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934523503"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934523503"}]},"ts":"1689934523503"} 2023-07-21 10:15:23,506 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure 31fbc556402ce3039b2616a61d7e41d1, server=jenkins-hbase17.apache.org,36809,1689934328937}] 2023-07-21 10:15:23,512 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure f800e06e096f85958fdb4fd2d039b84b, server=jenkins-hbase17.apache.org,37151,1689934329015}] 2023-07-21 10:15:23,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-21 10:15:23,660 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 31fbc556402ce3039b2616a61d7e41d1 2023-07-21 10:15:23,660 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 31fbc556402ce3039b2616a61d7e41d1, disabling compactions & flushes 2023-07-21 10:15:23,660 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689934499397.31fbc556402ce3039b2616a61d7e41d1. 2023-07-21 10:15:23,660 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689934499397.31fbc556402ce3039b2616a61d7e41d1. 2023-07-21 10:15:23,660 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689934499397.31fbc556402ce3039b2616a61d7e41d1. after waiting 0 ms 2023-07-21 10:15:23,660 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689934499397.31fbc556402ce3039b2616a61d7e41d1. 2023-07-21 10:15:23,664 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close f800e06e096f85958fdb4fd2d039b84b 2023-07-21 10:15:23,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing f800e06e096f85958fdb4fd2d039b84b, disabling compactions & flushes 2023-07-21 10:15:23,665 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689934499397.f800e06e096f85958fdb4fd2d039b84b. 2023-07-21 10:15:23,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689934499397.f800e06e096f85958fdb4fd2d039b84b. 2023-07-21 10:15:23,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689934499397.f800e06e096f85958fdb4fd2d039b84b. after waiting 0 ms 2023-07-21 10:15:23,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689934499397.f800e06e096f85958fdb4fd2d039b84b. 2023-07-21 10:15:23,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithSkipTmp/31fbc556402ce3039b2616a61d7e41d1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 10:15:23,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:15:23,682 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689934499397.31fbc556402ce3039b2616a61d7e41d1. 2023-07-21 10:15:23,682 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 31fbc556402ce3039b2616a61d7e41d1: 2023-07-21 10:15:23,682 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/default/testtb-testExportFileSystemStateWithSkipTmp/f800e06e096f85958fdb4fd2d039b84b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 10:15:23,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:15:23,684 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689934499397.f800e06e096f85958fdb4fd2d039b84b. 2023-07-21 10:15:23,684 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for f800e06e096f85958fdb4fd2d039b84b: 2023-07-21 10:15:23,684 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 31fbc556402ce3039b2616a61d7e41d1 2023-07-21 10:15:23,685 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=31fbc556402ce3039b2616a61d7e41d1, regionState=CLOSED 2023-07-21 10:15:23,685 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689934499397.31fbc556402ce3039b2616a61d7e41d1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689934523685"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934523685"}]},"ts":"1689934523685"} 2023-07-21 10:15:23,685 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed f800e06e096f85958fdb4fd2d039b84b 2023-07-21 10:15:23,686 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=f800e06e096f85958fdb4fd2d039b84b, regionState=CLOSED 2023-07-21 10:15:23,686 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689934499397.f800e06e096f85958fdb4fd2d039b84b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689934523686"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934523686"}]},"ts":"1689934523686"} 2023-07-21 10:15:23,688 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-21 10:15:23,688 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure 31fbc556402ce3039b2616a61d7e41d1, server=jenkins-hbase17.apache.org,36809,1689934328937 in 180 msec 2023-07-21 10:15:23,688 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=31fbc556402ce3039b2616a61d7e41d1, UNASSIGN in 191 msec 2023-07-21 10:15:23,690 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-21 10:15:23,690 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure f800e06e096f85958fdb4fd2d039b84b, server=jenkins-hbase17.apache.org,37151,1689934329015 in 178 msec 2023-07-21 10:15:23,691 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-21 10:15:23,692 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f800e06e096f85958fdb4fd2d039b84b, UNASSIGN in 193 msec 2023-07-21 10:15:23,692 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934523692"}]},"ts":"1689934523692"} 2023-07-21 10:15:23,693 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-21 10:15:23,694 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-21 10:15:23,695 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 209 msec 2023-07-21 10:15:23,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-21 10:15:23,795 INFO [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-21 10:15:23,795 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:23,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:23,798 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:23,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:23,799 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:23,800 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37151] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:23,802 DEBUG [HFileArchiver-27] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f800e06e096f85958fdb4fd2d039b84b 2023-07-21 10:15:23,803 DEBUG [HFileArchiver-28] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/31fbc556402ce3039b2616a61d7e41d1 2023-07-21 10:15:23,804 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:23,804 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:23,804 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:23,804 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:23,804 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-21 10:15:23,805 DEBUG [HFileArchiver-27] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f800e06e096f85958fdb4fd2d039b84b/cf, FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f800e06e096f85958fdb4fd2d039b84b/recovered.edits] 2023-07-21 10:15:23,805 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-21 10:15:23,805 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-21 10:15:23,805 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-21 10:15:23,805 DEBUG [HFileArchiver-28] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/31fbc556402ce3039b2616a61d7e41d1/cf, FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/31fbc556402ce3039b2616a61d7e41d1/recovered.edits] 2023-07-21 10:15:23,805 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:23,805 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:15:23,805 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:23,805 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:15:23,805 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:23,806 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:15:23,806 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:23,806 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:15:23,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-21 10:15:23,815 DEBUG [HFileArchiver-28] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/31fbc556402ce3039b2616a61d7e41d1/cf/701266a918e44c97bb4917cd39264a8b to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/31fbc556402ce3039b2616a61d7e41d1/cf/701266a918e44c97bb4917cd39264a8b 2023-07-21 10:15:23,820 DEBUG [HFileArchiver-28] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/31fbc556402ce3039b2616a61d7e41d1/recovered.edits/9.seqid to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/31fbc556402ce3039b2616a61d7e41d1/recovered.edits/9.seqid 2023-07-21 10:15:23,820 DEBUG [HFileArchiver-28] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/31fbc556402ce3039b2616a61d7e41d1 2023-07-21 10:15:23,821 DEBUG [HFileArchiver-27] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f800e06e096f85958fdb4fd2d039b84b/cf/f806fdecf401481d996cc08d26a4b241 to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/f800e06e096f85958fdb4fd2d039b84b/cf/f806fdecf401481d996cc08d26a4b241 2023-07-21 10:15:23,823 DEBUG [HFileArchiver-27] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f800e06e096f85958fdb4fd2d039b84b/recovered.edits/9.seqid to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/f800e06e096f85958fdb4fd2d039b84b/recovered.edits/9.seqid 2023-07-21 10:15:23,824 DEBUG [HFileArchiver-27] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f800e06e096f85958fdb4fd2d039b84b 2023-07-21 10:15:23,824 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-21 10:15:23,824 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-21 10:15:23,825 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-21 10:15:23,827 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023072156cc3ec5ef7c4856bf4c11ad3d7ebd9d to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023072156cc3ec5ef7c4856bf4c11ad3d7ebd9d 2023-07-21 10:15:23,829 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230721485e4daeedcc4f6caea30c8e545f72e9 to hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230721485e4daeedcc4f6caea30c8e545f72e9 2023-07-21 10:15:23,829 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-21 10:15:23,832 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:23,846 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-21 10:15:23,847 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-21 10:15:23,848 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:23,848 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-21 10:15:23,848 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689934499397.f800e06e096f85958fdb4fd2d039b84b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689934523848"}]},"ts":"9223372036854775807"} 2023-07-21 10:15:23,849 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689934499397.31fbc556402ce3039b2616a61d7e41d1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689934523848"}]},"ts":"9223372036854775807"} 2023-07-21 10:15:23,850 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-21 10:15:23,850 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f800e06e096f85958fdb4fd2d039b84b, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689934499397.f800e06e096f85958fdb4fd2d039b84b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 31fbc556402ce3039b2616a61d7e41d1, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689934499397.31fbc556402ce3039b2616a61d7e41d1.', STARTKEY => '1', ENDKEY => ''}] 2023-07-21 10:15:23,850 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-21 10:15:23,850 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689934523850"}]},"ts":"9223372036854775807"} 2023-07-21 10:15:23,851 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-21 10:15:23,855 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:23,857 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 60 msec 2023-07-21 10:15:23,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-21 10:15:23,908 INFO [Listener at jenkins-hbase17.apache.org/42227] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-21 10:15:23,916 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-21 10:15:23,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:23,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-21 10:15:23,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35385] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:23,967 INFO [Listener at jenkins-hbase17.apache.org/42227] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764 (was 762) Potentially hanging thread: hconnection-0x1bf23fcf-shared-pool-55 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1557406679_17 at /127.0.0.1:43416 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5440 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x1bf23fcf-shared-pool-56 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1863871772_1 at /127.0.0.1:40730 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MoveIntermediateToDone Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1bf23fcf-shared-pool-53 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MoveIntermediateToDone Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1863871772_1 at /127.0.0.1:43376 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MoveIntermediateToDone Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1bf23fcf-shared-pool-54 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (804182503) connection to jenkins-hbase17.apache.org/136.243.18.41:42703 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ContainersLauncher #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1557406679_17 at /127.0.0.1:40760 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=900 (was 904), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1424 (was 1504), ProcessCount=194 (was 194), AvailableMemoryMB=1286 (was 1442) 2023-07-21 10:15:23,967 WARN [Listener at jenkins-hbase17.apache.org/42227] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-21 10:15:23,967 INFO [Listener at jenkins-hbase17.apache.org/42227] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-21 10:15:23,985 INFO [Listener at jenkins-hbase17.apache.org/42227] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:0 2023-07-21 10:15:24,014 WARN [ContainersLauncher #2] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689934340509_0007_01_000001 is : 143 2023-07-21 10:15:29,309 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 10:15:38,010 INFO [Listener at jenkins-hbase17.apache.org/42227] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:0 2023-07-21 10:15:52,132 ERROR [Thread[Thread-412,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-21 10:15:52,132 INFO [Listener at jenkins-hbase17.apache.org/42227] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:0 2023-07-21 10:15:52,243 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-21 10:15:52,263 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-21 10:15:52,264 ERROR [Thread[Thread-422,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-21 10:15:52,281 INFO [Listener at jenkins-hbase17.apache.org/42227] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:0 2023-07-21 10:15:52,393 ERROR [Thread[Thread-386,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-21 10:15:52,394 INFO [Listener at jenkins-hbase17.apache.org/42227] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-21 10:15:52,394 INFO [Listener at jenkins-hbase17.apache.org/42227] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-21 10:15:52,394 INFO [Listener at jenkins-hbase17.apache.org/42227] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-21 10:15:52,394 DEBUG [Listener at jenkins-hbase17.apache.org/42227] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x73e2c378 to 127.0.0.1:56971 2023-07-21 10:15:52,394 DEBUG [Listener at jenkins-hbase17.apache.org/42227] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:15:52,394 DEBUG [Listener at jenkins-hbase17.apache.org/42227] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-21 10:15:52,394 DEBUG [Listener at jenkins-hbase17.apache.org/42227] util.JVMClusterUtil(257): Found active master hash=365293407, stopped=false 2023-07-21 10:15:52,394 DEBUG [Listener at jenkins-hbase17.apache.org/42227] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:15:52,394 DEBUG [Listener at jenkins-hbase17.apache.org/42227] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-21 10:15:52,395 INFO [Listener at jenkins-hbase17.apache.org/42227] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase17.apache.org,35385,1689934327246 2023-07-21 10:15:52,396 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-21 10:15:52,396 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-21 10:15:52,396 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 10:15:52,396 INFO [Listener at jenkins-hbase17.apache.org/42227] procedure2.ProcedureExecutor(629): Stopping 2023-07-21 10:15:52,396 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-21 10:15:52,396 DEBUG [Listener at jenkins-hbase17.apache.org/42227] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6f52a01b to 127.0.0.1:56971 2023-07-21 10:15:52,396 DEBUG [Listener at jenkins-hbase17.apache.org/42227] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:15:52,396 INFO [Listener at jenkins-hbase17.apache.org/42227] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,36809,1689934328937' ***** 2023-07-21 10:15:52,396 DEBUG [Listener at jenkins-hbase17.apache.org/42227] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:15:52,397 INFO [Listener at jenkins-hbase17.apache.org/42227] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-21 10:15:52,397 INFO [Listener at jenkins-hbase17.apache.org/42227] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,37151,1689934329015' ***** 2023-07-21 10:15:52,397 DEBUG [Listener at jenkins-hbase17.apache.org/42227] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:15:52,397 INFO [Listener at jenkins-hbase17.apache.org/42227] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-21 10:15:52,397 INFO [Listener at jenkins-hbase17.apache.org/42227] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,38751,1689934329069' ***** 2023-07-21 10:15:52,397 DEBUG [Listener at jenkins-hbase17.apache.org/42227] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:15:52,397 INFO [Listener at jenkins-hbase17.apache.org/42227] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-21 10:15:52,397 INFO [RS:1;jenkins-hbase17:37151] regionserver.HeapMemoryManager(220): Stopping 2023-07-21 10:15:52,397 INFO [RS:1;jenkins-hbase17:37151] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-21 10:15:52,397 INFO [RS:1;jenkins-hbase17:37151] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-21 10:15:52,397 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-21 10:15:52,398 INFO [RS:1;jenkins-hbase17:37151] regionserver.HRegionServer(3305): Received CLOSE for cc2f998fff196f1e13865138a480e54b 2023-07-21 10:15:52,398 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 10:15:52,398 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 10:15:52,398 INFO [RS:1;jenkins-hbase17:37151] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:52,398 DEBUG [RS:1;jenkins-hbase17:37151] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x600ebf08 to 127.0.0.1:56971 2023-07-21 10:15:52,397 INFO [RS:2;jenkins-hbase17:38751] regionserver.HeapMemoryManager(220): Stopping 2023-07-21 10:15:52,400 INFO [RS:2;jenkins-hbase17:38751] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-21 10:15:52,400 INFO [RS:2;jenkins-hbase17:38751] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-21 10:15:52,400 INFO [RS:2;jenkins-hbase17:38751] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:15:52,401 DEBUG [RS:2;jenkins-hbase17:38751] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x08683d7e to 127.0.0.1:56971 2023-07-21 10:15:52,401 DEBUG [RS:2;jenkins-hbase17:38751] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:15:52,400 DEBUG [RS:1;jenkins-hbase17:37151] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:15:52,399 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing cc2f998fff196f1e13865138a480e54b, disabling compactions & flushes 2023-07-21 10:15:52,398 INFO [RS:0;jenkins-hbase17:36809] regionserver.HeapMemoryManager(220): Stopping 2023-07-21 10:15:52,405 INFO [RS:0;jenkins-hbase17:36809] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-21 10:15:52,405 INFO [RS:0;jenkins-hbase17:36809] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-21 10:15:52,405 INFO [RS:0;jenkins-hbase17:36809] regionserver.HRegionServer(3305): Received CLOSE for 646c4734d454181f95516b751d1a6763 2023-07-21 10:15:52,405 INFO [RS:0;jenkins-hbase17:36809] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:52,405 DEBUG [RS:0;jenkins-hbase17:36809] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x48baed7b to 127.0.0.1:56971 2023-07-21 10:15:52,405 DEBUG [RS:0;jenkins-hbase17:36809] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:15:52,398 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 10:15:52,405 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-21 10:15:52,405 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689934334443.cc2f998fff196f1e13865138a480e54b. 2023-07-21 10:15:52,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689934334443.cc2f998fff196f1e13865138a480e54b. 2023-07-21 10:15:52,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689934334443.cc2f998fff196f1e13865138a480e54b. after waiting 0 ms 2023-07-21 10:15:52,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689934334443.cc2f998fff196f1e13865138a480e54b. 2023-07-21 10:15:52,404 INFO [RS:2;jenkins-hbase17:38751] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-21 10:15:52,409 INFO [RS:2;jenkins-hbase17:38751] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-21 10:15:52,409 INFO [RS:2;jenkins-hbase17:38751] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-21 10:15:52,409 INFO [RS:2;jenkins-hbase17:38751] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-21 10:15:52,403 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-21 10:15:52,400 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-21 10:15:52,409 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing cc2f998fff196f1e13865138a480e54b 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-21 10:15:52,410 INFO [RS:1;jenkins-hbase17:37151] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-21 10:15:52,410 DEBUG [RS:1;jenkins-hbase17:37151] regionserver.HRegionServer(1478): Online Regions={cc2f998fff196f1e13865138a480e54b=hbase:acl,,1689934334443.cc2f998fff196f1e13865138a480e54b.} 2023-07-21 10:15:52,410 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 10:15:52,411 DEBUG [RS:1;jenkins-hbase17:37151] regionserver.HRegionServer(1504): Waiting on cc2f998fff196f1e13865138a480e54b 2023-07-21 10:15:52,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 646c4734d454181f95516b751d1a6763, disabling compactions & flushes 2023-07-21 10:15:52,411 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689934333342.646c4734d454181f95516b751d1a6763. 2023-07-21 10:15:52,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689934333342.646c4734d454181f95516b751d1a6763. 2023-07-21 10:15:52,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689934333342.646c4734d454181f95516b751d1a6763. after waiting 0 ms 2023-07-21 10:15:52,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689934333342.646c4734d454181f95516b751d1a6763. 2023-07-21 10:15:52,411 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 646c4734d454181f95516b751d1a6763 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-21 10:15:52,411 INFO [RS:0;jenkins-hbase17:36809] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-21 10:15:52,412 DEBUG [RS:0;jenkins-hbase17:36809] regionserver.HRegionServer(1478): Online Regions={646c4734d454181f95516b751d1a6763=hbase:namespace,,1689934333342.646c4734d454181f95516b751d1a6763.} 2023-07-21 10:15:52,412 DEBUG [RS:0;jenkins-hbase17:36809] regionserver.HRegionServer(1504): Waiting on 646c4734d454181f95516b751d1a6763 2023-07-21 10:15:52,416 INFO [RS:2;jenkins-hbase17:38751] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-21 10:15:52,416 DEBUG [RS:2;jenkins-hbase17:38751] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-21 10:15:52,416 DEBUG [RS:2;jenkins-hbase17:38751] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-21 10:15:52,437 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-21 10:15:52,437 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-21 10:15:52,437 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-21 10:15:52,437 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-21 10:15:52,437 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-21 10:15:52,437 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.97 KB heapSize=71.98 KB 2023-07-21 10:15:52,451 INFO [regionserver/jenkins-hbase17:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-21 10:15:52,475 INFO [regionserver/jenkins-hbase17:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-21 10:15:52,480 INFO [regionserver/jenkins-hbase17:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-21 10:15:52,604 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/namespace/646c4734d454181f95516b751d1a6763/.tmp/info/52ce2ba72f9a4838b6bf1407c923174a 2023-07-21 10:15:52,611 DEBUG [RS:1;jenkins-hbase17:37151] regionserver.HRegionServer(1504): Waiting on cc2f998fff196f1e13865138a480e54b 2023-07-21 10:15:52,612 DEBUG [RS:0;jenkins-hbase17:36809] regionserver.HRegionServer(1504): Waiting on 646c4734d454181f95516b751d1a6763 2023-07-21 10:15:52,618 DEBUG [RS:2;jenkins-hbase17:38751] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-21 10:15:52,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/namespace/646c4734d454181f95516b751d1a6763/.tmp/info/52ce2ba72f9a4838b6bf1407c923174a as hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/namespace/646c4734d454181f95516b751d1a6763/info/52ce2ba72f9a4838b6bf1407c923174a 2023-07-21 10:15:52,632 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/acl/cc2f998fff196f1e13865138a480e54b/.tmp/l/b4bb11897389416898ff97caf4bf0cfb 2023-07-21 10:15:52,634 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/meta/1588230740/.tmp/info/511542f504a14c4d8436d75d66b4ea7c 2023-07-21 10:15:52,635 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/namespace/646c4734d454181f95516b751d1a6763/info/52ce2ba72f9a4838b6bf1407c923174a, entries=2, sequenceid=6, filesize=4.8 K 2023-07-21 10:15:52,640 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 646c4734d454181f95516b751d1a6763 in 229ms, sequenceid=6, compaction requested=false 2023-07-21 10:15:52,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/namespace/646c4734d454181f95516b751d1a6763/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 10:15:52,660 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b4bb11897389416898ff97caf4bf0cfb 2023-07-21 10:15:52,660 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:15:52,661 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689934333342.646c4734d454181f95516b751d1a6763. 2023-07-21 10:15:52,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 646c4734d454181f95516b751d1a6763: 2023-07-21 10:15:52,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689934333342.646c4734d454181f95516b751d1a6763. 2023-07-21 10:15:52,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/acl/cc2f998fff196f1e13865138a480e54b/.tmp/l/b4bb11897389416898ff97caf4bf0cfb as hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/acl/cc2f998fff196f1e13865138a480e54b/l/b4bb11897389416898ff97caf4bf0cfb 2023-07-21 10:15:52,663 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 511542f504a14c4d8436d75d66b4ea7c 2023-07-21 10:15:52,668 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b4bb11897389416898ff97caf4bf0cfb 2023-07-21 10:15:52,669 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/acl/cc2f998fff196f1e13865138a480e54b/l/b4bb11897389416898ff97caf4bf0cfb, entries=7, sequenceid=18, filesize=5.2 K 2023-07-21 10:15:52,670 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for cc2f998fff196f1e13865138a480e54b in 261ms, sequenceid=18, compaction requested=false 2023-07-21 10:15:52,704 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/meta/1588230740/.tmp/rep_barrier/fb95df16cac74fd8a9d906dc94b99fd3 2023-07-21 10:15:52,705 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/acl/cc2f998fff196f1e13865138a480e54b/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-21 10:15:52,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:15:52,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689934334443.cc2f998fff196f1e13865138a480e54b. 2023-07-21 10:15:52,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for cc2f998fff196f1e13865138a480e54b: 2023-07-21 10:15:52,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689934334443.cc2f998fff196f1e13865138a480e54b. 2023-07-21 10:15:52,719 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fb95df16cac74fd8a9d906dc94b99fd3 2023-07-21 10:15:52,730 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/meta/1588230740/.tmp/table/b610bc914c664ce3968a8d17504e7200 2023-07-21 10:15:52,734 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b610bc914c664ce3968a8d17504e7200 2023-07-21 10:15:52,735 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/meta/1588230740/.tmp/info/511542f504a14c4d8436d75d66b4ea7c as hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/meta/1588230740/info/511542f504a14c4d8436d75d66b4ea7c 2023-07-21 10:15:52,738 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 511542f504a14c4d8436d75d66b4ea7c 2023-07-21 10:15:52,738 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/meta/1588230740/info/511542f504a14c4d8436d75d66b4ea7c, entries=48, sequenceid=131, filesize=10.3 K 2023-07-21 10:15:52,739 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/meta/1588230740/.tmp/rep_barrier/fb95df16cac74fd8a9d906dc94b99fd3 as hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/meta/1588230740/rep_barrier/fb95df16cac74fd8a9d906dc94b99fd3 2023-07-21 10:15:52,744 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fb95df16cac74fd8a9d906dc94b99fd3 2023-07-21 10:15:52,744 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/meta/1588230740/rep_barrier/fb95df16cac74fd8a9d906dc94b99fd3, entries=13, sequenceid=131, filesize=6.4 K 2023-07-21 10:15:52,745 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/meta/1588230740/.tmp/table/b610bc914c664ce3968a8d17504e7200 as hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/meta/1588230740/table/b610bc914c664ce3968a8d17504e7200 2023-07-21 10:15:52,749 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b610bc914c664ce3968a8d17504e7200 2023-07-21 10:15:52,749 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/meta/1588230740/table/b610bc914c664ce3968a8d17504e7200, entries=24, sequenceid=131, filesize=6.9 K 2023-07-21 10:15:52,750 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.97 KB/47078, heapSize ~71.93 KB/73656, currentSize=0 B/0 for 1588230740 in 313ms, sequenceid=131, compaction requested=false 2023-07-21 10:15:52,759 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-21 10:15:52,760 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:15:52,760 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-21 10:15:52,760 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-21 10:15:52,760 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-21 10:15:52,760 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-21 10:15:52,811 INFO [RS:1;jenkins-hbase17:37151] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,37151,1689934329015; all regions closed. 2023-07-21 10:15:52,812 INFO [RS:0;jenkins-hbase17:36809] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,36809,1689934328937; all regions closed. 2023-07-21 10:15:52,821 INFO [RS:2;jenkins-hbase17:38751] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,38751,1689934329069; all regions closed. 2023-07-21 10:15:52,833 DEBUG [RS:2;jenkins-hbase17:38751] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/oldWALs 2023-07-21 10:15:52,833 INFO [RS:2;jenkins-hbase17:38751] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C38751%2C1689934329069.meta:.meta(num 1689934332757) 2023-07-21 10:15:52,834 DEBUG [RS:1;jenkins-hbase17:37151] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/oldWALs 2023-07-21 10:15:52,834 INFO [RS:1;jenkins-hbase17:37151] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C37151%2C1689934329015:(num 1689934332137) 2023-07-21 10:15:52,834 DEBUG [RS:1;jenkins-hbase17:37151] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:15:52,834 INFO [RS:1;jenkins-hbase17:37151] regionserver.LeaseManager(133): Closed leases 2023-07-21 10:15:52,833 DEBUG [RS:0;jenkins-hbase17:36809] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/oldWALs 2023-07-21 10:15:52,834 INFO [RS:0;jenkins-hbase17:36809] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C36809%2C1689934328937:(num 1689934332076) 2023-07-21 10:15:52,834 DEBUG [RS:0;jenkins-hbase17:36809] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:15:52,834 INFO [RS:0;jenkins-hbase17:36809] regionserver.LeaseManager(133): Closed leases 2023-07-21 10:15:52,836 INFO [RS:0;jenkins-hbase17:36809] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase17:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-21 10:15:52,844 INFO [RS:1;jenkins-hbase17:37151] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase17:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-21 10:15:52,844 INFO [RS:0;jenkins-hbase17:36809] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-21 10:15:52,844 INFO [RS:0;jenkins-hbase17:36809] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-21 10:15:52,844 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-21 10:15:52,845 INFO [RS:1;jenkins-hbase17:37151] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-21 10:15:52,845 INFO [RS:1;jenkins-hbase17:37151] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-21 10:15:52,845 INFO [RS:1;jenkins-hbase17:37151] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-21 10:15:52,844 INFO [RS:0;jenkins-hbase17:36809] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-21 10:15:52,845 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-21 10:15:52,847 INFO [RS:1;jenkins-hbase17:37151] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:37151 2023-07-21 10:15:52,848 INFO [RS:0;jenkins-hbase17:36809] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:36809 2023-07-21 10:15:52,854 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:52,854 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:52,855 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-21 10:15:52,855 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,36809,1689934328937 2023-07-21 10:15:52,855 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-21 10:15:52,855 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-21 10:15:52,855 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-21 10:15:52,855 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:52,856 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:52,856 DEBUG [RS:2;jenkins-hbase17:38751] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/oldWALs 2023-07-21 10:15:52,856 INFO [RS:2;jenkins-hbase17:38751] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C38751%2C1689934329069:(num 1689934332133) 2023-07-21 10:15:52,856 DEBUG [RS:2;jenkins-hbase17:38751] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:15:52,856 INFO [RS:2;jenkins-hbase17:38751] regionserver.LeaseManager(133): Closed leases 2023-07-21 10:15:52,856 INFO [RS:2;jenkins-hbase17:38751] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase17:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-21 10:15:52,857 INFO [RS:2;jenkins-hbase17:38751] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:38751 2023-07-21 10:15:52,857 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-21 10:15:52,859 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,37151,1689934329015 2023-07-21 10:15:52,859 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase17.apache.org,37151,1689934329015] 2023-07-21 10:15:52,860 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase17.apache.org,37151,1689934329015; numProcessing=1 2023-07-21 10:15:52,861 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:15:52,861 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-21 10:15:52,861 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,38751,1689934329069 2023-07-21 10:15:52,861 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase17.apache.org,37151,1689934329015 already deleted, retry=false 2023-07-21 10:15:52,861 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase17.apache.org,37151,1689934329015 expired; onlineServers=2 2023-07-21 10:15:52,861 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase17.apache.org,36809,1689934328937] 2023-07-21 10:15:52,861 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase17.apache.org,36809,1689934328937; numProcessing=2 2023-07-21 10:15:52,862 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase17.apache.org,36809,1689934328937 already deleted, retry=false 2023-07-21 10:15:52,863 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase17.apache.org,36809,1689934328937 expired; onlineServers=1 2023-07-21 10:15:52,863 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase17.apache.org,38751,1689934329069] 2023-07-21 10:15:52,863 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase17.apache.org,38751,1689934329069; numProcessing=3 2023-07-21 10:15:52,864 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase17.apache.org,38751,1689934329069 already deleted, retry=false 2023-07-21 10:15:52,864 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase17.apache.org,38751,1689934329069 expired; onlineServers=0 2023-07-21 10:15:52,864 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,35385,1689934327246' ***** 2023-07-21 10:15:52,864 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-21 10:15:52,864 DEBUG [M:0;jenkins-hbase17:35385] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@54f8e564, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-07-21 10:15:52,864 INFO [M:0;jenkins-hbase17:35385] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,35385,1689934327246 2023-07-21 10:15:52,864 INFO [M:0;jenkins-hbase17:35385] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,35385,1689934327246; all regions closed. 2023-07-21 10:15:52,864 DEBUG [M:0;jenkins-hbase17:35385] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:15:52,864 DEBUG [M:0;jenkins-hbase17:35385] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-21 10:15:52,864 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-21 10:15:52,864 DEBUG [M:0;jenkins-hbase17:35385] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-21 10:15:52,865 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1689934331226] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1689934331226,5,FailOnTimeoutGroup] 2023-07-21 10:15:52,865 INFO [M:0;jenkins-hbase17:35385] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-21 10:15:52,865 INFO [M:0;jenkins-hbase17:35385] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-21 10:15:52,865 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1689934331238] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1689934331238,5,FailOnTimeoutGroup] 2023-07-21 10:15:52,865 INFO [M:0;jenkins-hbase17:35385] hbase.ChoreService(369): Chore service for: master/jenkins-hbase17:0 had [] on shutdown 2023-07-21 10:15:52,865 DEBUG [M:0;jenkins-hbase17:35385] master.HMaster(1512): Stopping service threads 2023-07-21 10:15:52,865 INFO [M:0;jenkins-hbase17:35385] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-21 10:15:52,865 ERROR [M:0;jenkins-hbase17:35385] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-27,5,PEWorkerGroup] Thread[HFileArchiver-28,5,PEWorkerGroup] 2023-07-21 10:15:52,866 INFO [M:0;jenkins-hbase17:35385] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-21 10:15:52,866 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-21 10:15:52,868 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-21 10:15:52,868 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 10:15:52,869 DEBUG [M:0;jenkins-hbase17:35385] zookeeper.RecoverableZooKeeper(172): Node /hbase/master already deleted, retry=false 2023-07-21 10:15:52,869 DEBUG [M:0;jenkins-hbase17:35385] master.ActiveMasterManager(335): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Failed delete of our master address node; KeeperErrorCode = NoNode for /hbase/master 2023-07-21 10:15:52,869 INFO [M:0;jenkins-hbase17:35385] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-21 10:15:52,869 INFO [M:0;jenkins-hbase17:35385] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-21 10:15:52,872 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-21 10:15:52,872 DEBUG [M:0;jenkins-hbase17:35385] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-21 10:15:52,872 INFO [M:0;jenkins-hbase17:35385] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 10:15:52,872 DEBUG [M:0;jenkins-hbase17:35385] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 10:15:52,873 DEBUG [M:0;jenkins-hbase17:35385] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-21 10:15:52,873 DEBUG [M:0;jenkins-hbase17:35385] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 10:15:52,873 INFO [M:0;jenkins-hbase17:35385] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=376.28 KB heapSize=452.46 KB 2023-07-21 10:15:52,907 INFO [M:0;jenkins-hbase17:35385] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=376.28 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/87d1b904e4504eb28b7c6c24474e3264 2023-07-21 10:15:52,913 INFO [M:0;jenkins-hbase17:35385] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 87d1b904e4504eb28b7c6c24474e3264 2023-07-21 10:15:52,929 DEBUG [M:0;jenkins-hbase17:35385] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/87d1b904e4504eb28b7c6c24474e3264 as hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/87d1b904e4504eb28b7c6c24474e3264 2023-07-21 10:15:52,936 INFO [M:0;jenkins-hbase17:35385] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 87d1b904e4504eb28b7c6c24474e3264 2023-07-21 10:15:52,936 INFO [M:0;jenkins-hbase17:35385] regionserver.HStore(1080): Added hdfs://localhost.localdomain:35937/user/jenkins/test-data/363a841b-fbb9-0dda-a7b6-3bb08f11e79f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/87d1b904e4504eb28b7c6c24474e3264, entries=119, sequenceid=899, filesize=28.7 K 2023-07-21 10:15:52,937 INFO [M:0;jenkins-hbase17:35385] regionserver.HRegion(2948): Finished flush of dataSize ~376.28 KB/385314, heapSize ~452.45 KB/463304, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 64ms, sequenceid=899, compaction requested=false 2023-07-21 10:15:52,954 INFO [M:0;jenkins-hbase17:35385] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 10:15:52,954 DEBUG [M:0;jenkins-hbase17:35385] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-21 10:15:52,959 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 10:15:52,959 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:36809-0x101875ce5c10001, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 10:15:52,959 INFO [RS:0;jenkins-hbase17:36809] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,36809,1689934328937; zookeeper connection closed. 2023-07-21 10:15:52,963 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1900b0eb] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1900b0eb 2023-07-21 10:15:52,972 INFO [M:0;jenkins-hbase17:35385] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-21 10:15:52,973 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-21 10:15:52,973 INFO [M:0;jenkins-hbase17:35385] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:35385 2023-07-21 10:15:52,975 DEBUG [M:0;jenkins-hbase17:35385] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase17.apache.org,35385,1689934327246 already deleted, retry=false 2023-07-21 10:15:53,059 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 10:15:53,059 INFO [RS:2;jenkins-hbase17:38751] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,38751,1689934329069; zookeeper connection closed. 2023-07-21 10:15:53,059 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:38751-0x101875ce5c10003, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 10:15:53,060 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6f9ec334] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6f9ec334 2023-07-21 10:15:53,160 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 10:15:53,160 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): regionserver:37151-0x101875ce5c10002, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 10:15:53,160 INFO [RS:1;jenkins-hbase17:37151] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,37151,1689934329015; zookeeper connection closed. 2023-07-21 10:15:53,160 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@42691850] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@42691850 2023-07-21 10:15:53,160 INFO [Listener at jenkins-hbase17.apache.org/42227] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-21 10:15:53,260 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 10:15:53,260 INFO [M:0;jenkins-hbase17:35385] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,35385,1689934327246; zookeeper connection closed. 2023-07-21 10:15:53,260 DEBUG [Listener at localhost.localdomain/37301-EventThread] zookeeper.ZKWatcher(600): master:35385-0x101875ce5c10000, quorum=127.0.0.1:56971, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 10:15:53,262 WARN [Listener at jenkins-hbase17.apache.org/42227] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-21 10:15:53,353 INFO [Listener at jenkins-hbase17.apache.org/42227] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-21 10:15:53,458 WARN [BP-1911489806-136.243.18.41-1689934322290 heartbeating to localhost.localdomain/127.0.0.1:35937] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-21 10:15:53,458 WARN [BP-1911489806-136.243.18.41-1689934322290 heartbeating to localhost.localdomain/127.0.0.1:35937] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1911489806-136.243.18.41-1689934322290 (Datanode Uuid 29a3d87a-148d-407a-b69f-25f49469c08e) service to localhost.localdomain/127.0.0.1:35937 2023-07-21 10:15:53,460 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/cluster_d3b934de-fe44-3c44-e8a2-d5b9df6d6477/dfs/data/data5/current/BP-1911489806-136.243.18.41-1689934322290] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-21 10:15:53,460 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/cluster_d3b934de-fe44-3c44-e8a2-d5b9df6d6477/dfs/data/data6/current/BP-1911489806-136.243.18.41-1689934322290] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-21 10:15:53,463 WARN [Listener at jenkins-hbase17.apache.org/42227] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-21 10:15:53,470 INFO [Listener at jenkins-hbase17.apache.org/42227] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-21 10:15:53,573 WARN [BP-1911489806-136.243.18.41-1689934322290 heartbeating to localhost.localdomain/127.0.0.1:35937] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-21 10:15:53,573 WARN [BP-1911489806-136.243.18.41-1689934322290 heartbeating to localhost.localdomain/127.0.0.1:35937] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1911489806-136.243.18.41-1689934322290 (Datanode Uuid 9cce5eec-6129-46ed-a8cf-1f041d161f8b) service to localhost.localdomain/127.0.0.1:35937 2023-07-21 10:15:53,574 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/cluster_d3b934de-fe44-3c44-e8a2-d5b9df6d6477/dfs/data/data3/current/BP-1911489806-136.243.18.41-1689934322290] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-21 10:15:53,575 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/cluster_d3b934de-fe44-3c44-e8a2-d5b9df6d6477/dfs/data/data4/current/BP-1911489806-136.243.18.41-1689934322290] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-21 10:15:53,578 WARN [Listener at jenkins-hbase17.apache.org/42227] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-21 10:15:53,590 INFO [Listener at jenkins-hbase17.apache.org/42227] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-21 10:15:53,694 WARN [BP-1911489806-136.243.18.41-1689934322290 heartbeating to localhost.localdomain/127.0.0.1:35937] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-21 10:15:53,694 WARN [BP-1911489806-136.243.18.41-1689934322290 heartbeating to localhost.localdomain/127.0.0.1:35937] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1911489806-136.243.18.41-1689934322290 (Datanode Uuid afdacffc-3284-4be1-a4d9-6217036df168) service to localhost.localdomain/127.0.0.1:35937 2023-07-21 10:15:53,695 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/cluster_d3b934de-fe44-3c44-e8a2-d5b9df6d6477/dfs/data/data2/current/BP-1911489806-136.243.18.41-1689934322290] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-21 10:15:53,696 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/ab555175-e4e0-0b0f-5b1d-e89d5b2ac85f/cluster_d3b934de-fe44-3c44-e8a2-d5b9df6d6477/dfs/data/data1/current/BP-1911489806-136.243.18.41-1689934322290] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-21 10:15:53,735 INFO [Listener at jenkins-hbase17.apache.org/42227] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-07-21 10:15:53,872 INFO [Listener at jenkins-hbase17.apache.org/42227] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-21 10:15:53,990 INFO [Listener at jenkins-hbase17.apache.org/42227] hbase.HBaseTestingUtility(1293): Minicluster is down