2023-09-21 08:01:13,073 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-21 08:01:13,305 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c 2023-09-21 08:01:13,305 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-21 08:01:13,305 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-21 08:01:13,349 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-21 08:01:13,605 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-21 08:01:13,606 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/cluster_a1516829-53a1-8a15-7b69-24c58f59b133, deleteOnExit=true 2023-09-21 08:01:13,606 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-21 08:01:13,607 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/test.cache.data in system properties and HBase conf 2023-09-21 08:01:13,607 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/hadoop.tmp.dir in system properties and HBase conf 2023-09-21 08:01:13,607 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/hadoop.log.dir in system properties and HBase conf 2023-09-21 08:01:13,608 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-21 08:01:13,608 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-21 08:01:13,608 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-21 08:01:13,940 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-21 08:01:13,945 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-21 08:01:13,946 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-21 08:01:13,946 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-21 08:01:13,946 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-21 08:01:13,947 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-21 08:01:13,947 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-21 08:01:13,947 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-21 08:01:13,947 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-21 08:01:13,948 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-21 08:01:13,948 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/nfs.dump.dir in system properties and HBase conf 2023-09-21 08:01:13,948 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/java.io.tmpdir in system properties and HBase conf 2023-09-21 08:01:13,949 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-21 08:01:13,949 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-21 08:01:13,950 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-21 08:01:14,520 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-21 08:01:14,525 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-21 08:01:14,853 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-21 08:01:15,042 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-21 08:01:15,056 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-21 08:01:15,099 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-21 08:01:15,138 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/java.io.tmpdir/Jetty_localhost_34439_hdfs____fg6ern/webapp 2023-09-21 08:01:15,283 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34439 2023-09-21 08:01:15,295 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-21 08:01:15,295 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-21 08:01:15,799 WARN [Listener at localhost/42401] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-21 08:01:15,876 WARN [Listener at localhost/42401] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-21 08:01:15,898 WARN [Listener at localhost/42401] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-21 08:01:15,947 INFO [Listener at localhost/42401] log.Slf4jLog(67): jetty-6.1.26 2023-09-21 08:01:15,953 INFO [Listener at localhost/42401] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/java.io.tmpdir/Jetty_localhost_45855_datanode____xa68m6/webapp 2023-09-21 08:01:16,056 INFO [Listener at localhost/42401] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45855 2023-09-21 08:01:16,570 WARN [Listener at localhost/43757] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-21 08:01:16,586 WARN [Listener at localhost/43757] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-21 08:01:16,590 WARN [Listener at localhost/43757] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-21 08:01:16,593 INFO [Listener at localhost/43757] log.Slf4jLog(67): jetty-6.1.26 2023-09-21 08:01:16,606 INFO [Listener at localhost/43757] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/java.io.tmpdir/Jetty_localhost_43795_datanode____.87gajp/webapp 2023-09-21 08:01:16,715 INFO [Listener at localhost/43757] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43795 2023-09-21 08:01:16,727 WARN [Listener at localhost/42735] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-21 08:01:16,755 WARN [Listener at localhost/42735] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-21 08:01:16,758 WARN [Listener at localhost/42735] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-21 08:01:16,759 INFO [Listener at localhost/42735] log.Slf4jLog(67): jetty-6.1.26 2023-09-21 08:01:16,766 INFO [Listener at localhost/42735] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/java.io.tmpdir/Jetty_localhost_34805_datanode____.9vq1gd/webapp 2023-09-21 08:01:16,901 INFO [Listener at localhost/42735] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34805 2023-09-21 08:01:16,915 WARN [Listener at localhost/44993] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-21 08:01:17,175 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf116dcc55b34de1e: Processing first storage report for DS-91c81189-b3a7-43a3-97c6-67a032f525cc from datanode 52ce258f-a79c-418f-a60d-94176167cf08 2023-09-21 08:01:17,177 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf116dcc55b34de1e: from storage DS-91c81189-b3a7-43a3-97c6-67a032f525cc node DatanodeRegistration(127.0.0.1:40151, datanodeUuid=52ce258f-a79c-418f-a60d-94176167cf08, infoPort=44129, infoSecurePort=0, ipcPort=43757, storageInfo=lv=-57;cid=testClusterID;nsid=2052010315;c=1695283274615), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-09-21 08:01:17,177 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6382ef139323bab0: Processing first storage report for DS-d85f642f-7d5d-4706-a3fd-6939df7da4d0 from datanode fe7cd8e3-3030-4a6a-ad4d-4e5ffaa054d7 2023-09-21 08:01:17,177 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6382ef139323bab0: from storage DS-d85f642f-7d5d-4706-a3fd-6939df7da4d0 node DatanodeRegistration(127.0.0.1:39685, datanodeUuid=fe7cd8e3-3030-4a6a-ad4d-4e5ffaa054d7, infoPort=44701, infoSecurePort=0, ipcPort=44993, storageInfo=lv=-57;cid=testClusterID;nsid=2052010315;c=1695283274615), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-21 08:01:17,177 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb5953b29210b82de: Processing first storage report for DS-04344ddf-80cd-4861-ab82-f3516b203876 from datanode d3b0b7b9-a45e-4124-bf9a-1c81153548d8 2023-09-21 08:01:17,177 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb5953b29210b82de: from storage DS-04344ddf-80cd-4861-ab82-f3516b203876 node DatanodeRegistration(127.0.0.1:34519, datanodeUuid=d3b0b7b9-a45e-4124-bf9a-1c81153548d8, infoPort=34465, infoSecurePort=0, ipcPort=42735, storageInfo=lv=-57;cid=testClusterID;nsid=2052010315;c=1695283274615), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-21 08:01:17,178 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf116dcc55b34de1e: Processing first storage report for DS-aa2d493b-1772-4cea-83fb-1fbfaa80fbfd from datanode 52ce258f-a79c-418f-a60d-94176167cf08 2023-09-21 08:01:17,178 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf116dcc55b34de1e: from storage DS-aa2d493b-1772-4cea-83fb-1fbfaa80fbfd node DatanodeRegistration(127.0.0.1:40151, datanodeUuid=52ce258f-a79c-418f-a60d-94176167cf08, infoPort=44129, infoSecurePort=0, ipcPort=43757, storageInfo=lv=-57;cid=testClusterID;nsid=2052010315;c=1695283274615), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-21 08:01:17,178 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6382ef139323bab0: Processing first storage report for DS-94be37fe-2205-4f08-93f6-8cfc01dbef4b from datanode fe7cd8e3-3030-4a6a-ad4d-4e5ffaa054d7 2023-09-21 08:01:17,178 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6382ef139323bab0: from storage DS-94be37fe-2205-4f08-93f6-8cfc01dbef4b node DatanodeRegistration(127.0.0.1:39685, datanodeUuid=fe7cd8e3-3030-4a6a-ad4d-4e5ffaa054d7, infoPort=44701, infoSecurePort=0, ipcPort=44993, storageInfo=lv=-57;cid=testClusterID;nsid=2052010315;c=1695283274615), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-21 08:01:17,178 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb5953b29210b82de: Processing first storage report for DS-c0ec1ec5-2778-42b3-92e8-76508564535d from datanode d3b0b7b9-a45e-4124-bf9a-1c81153548d8 2023-09-21 08:01:17,178 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb5953b29210b82de: from storage DS-c0ec1ec5-2778-42b3-92e8-76508564535d node DatanodeRegistration(127.0.0.1:34519, datanodeUuid=d3b0b7b9-a45e-4124-bf9a-1c81153548d8, infoPort=34465, infoSecurePort=0, ipcPort=42735, storageInfo=lv=-57;cid=testClusterID;nsid=2052010315;c=1695283274615), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-21 08:01:17,402 DEBUG [Listener at localhost/44993] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c 2023-09-21 08:01:17,505 INFO [Listener at localhost/44993] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/cluster_a1516829-53a1-8a15-7b69-24c58f59b133/zookeeper_0, clientPort=58708, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/cluster_a1516829-53a1-8a15-7b69-24c58f59b133/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/cluster_a1516829-53a1-8a15-7b69-24c58f59b133/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-21 08:01:17,525 INFO [Listener at localhost/44993] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58708 2023-09-21 08:01:17,536 INFO [Listener at localhost/44993] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-21 08:01:17,538 INFO [Listener at localhost/44993] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-21 08:01:18,265 INFO [Listener at localhost/44993] util.FSUtils(471): Created version file at hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52 with version=8 2023-09-21 08:01:18,265 INFO [Listener at localhost/44993] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/hbase-staging 2023-09-21 08:01:18,686 INFO [Listener at localhost/44993] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-21 08:01:19,191 INFO [Listener at localhost/44993] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-09-21 08:01:19,224 INFO [Listener at localhost/44993] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-21 08:01:19,225 INFO [Listener at localhost/44993] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-21 08:01:19,225 INFO [Listener at localhost/44993] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-21 08:01:19,225 INFO [Listener at localhost/44993] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-21 08:01:19,225 INFO [Listener at localhost/44993] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-21 08:01:19,368 INFO [Listener at localhost/44993] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-21 08:01:19,441 DEBUG [Listener at localhost/44993] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-21 08:01:19,537 INFO [Listener at localhost/44993] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34581 2023-09-21 08:01:19,550 INFO [Listener at localhost/44993] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-21 08:01:19,552 INFO [Listener at localhost/44993] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-21 08:01:19,580 INFO [Listener at localhost/44993] zookeeper.RecoverableZooKeeper(93): Process identifier=master:34581 connecting to ZooKeeper ensemble=127.0.0.1:58708 2023-09-21 08:01:19,642 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:345810x0, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-21 08:01:19,645 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:34581-0x100cd8126510000 connected 2023-09-21 08:01:19,675 DEBUG [Listener at localhost/44993] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-21 08:01:19,676 DEBUG [Listener at localhost/44993] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-21 08:01:19,689 DEBUG [Listener at localhost/44993] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-21 08:01:19,701 DEBUG [Listener at localhost/44993] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34581 2023-09-21 08:01:19,701 DEBUG [Listener at localhost/44993] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34581 2023-09-21 08:01:19,702 DEBUG [Listener at localhost/44993] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34581 2023-09-21 08:01:19,702 DEBUG [Listener at localhost/44993] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34581 2023-09-21 08:01:19,703 DEBUG [Listener at localhost/44993] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34581 2023-09-21 08:01:19,712 INFO [Listener at localhost/44993] master.HMaster(444): hbase.rootdir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52, hbase.cluster.distributed=false 2023-09-21 08:01:19,786 INFO [Listener at localhost/44993] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-21 08:01:19,787 INFO [Listener at localhost/44993] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-21 08:01:19,787 INFO [Listener at localhost/44993] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-21 08:01:19,787 INFO [Listener at localhost/44993] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-21 08:01:19,788 INFO [Listener at localhost/44993] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-21 08:01:19,788 INFO [Listener at localhost/44993] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-21 08:01:19,793 INFO [Listener at localhost/44993] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-21 08:01:19,796 INFO [Listener at localhost/44993] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36469 2023-09-21 08:01:19,799 INFO [Listener at localhost/44993] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-21 08:01:19,807 INFO [Listener at localhost/44993] mob.MobFileCache(124): MobFileCache disabled 2023-09-21 08:01:19,808 INFO [Listener at localhost/44993] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-21 08:01:19,811 INFO [Listener at localhost/44993] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-21 08:01:19,814 INFO [Listener at localhost/44993] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36469 connecting to ZooKeeper ensemble=127.0.0.1:58708 2023-09-21 08:01:19,817 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:364690x0, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-21 08:01:19,819 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36469-0x100cd8126510001 connected 2023-09-21 08:01:19,819 DEBUG [Listener at localhost/44993] zookeeper.ZKUtil(164): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-21 08:01:19,820 DEBUG [Listener at localhost/44993] zookeeper.ZKUtil(164): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-21 08:01:19,821 DEBUG [Listener at localhost/44993] zookeeper.ZKUtil(164): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-21 08:01:19,825 DEBUG [Listener at localhost/44993] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36469 2023-09-21 08:01:19,825 DEBUG [Listener at localhost/44993] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36469 2023-09-21 08:01:19,825 DEBUG [Listener at localhost/44993] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36469 2023-09-21 08:01:19,827 DEBUG [Listener at localhost/44993] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36469 2023-09-21 08:01:19,827 DEBUG [Listener at localhost/44993] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36469 2023-09-21 08:01:19,841 INFO [Listener at localhost/44993] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-21 08:01:19,841 INFO [Listener at localhost/44993] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-21 08:01:19,841 INFO [Listener at localhost/44993] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-21 08:01:19,842 INFO [Listener at localhost/44993] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-21 08:01:19,842 INFO [Listener at localhost/44993] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-21 08:01:19,843 INFO [Listener at localhost/44993] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-21 08:01:19,843 INFO [Listener at localhost/44993] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-21 08:01:19,845 INFO [Listener at localhost/44993] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43299 2023-09-21 08:01:19,845 INFO [Listener at localhost/44993] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-21 08:01:19,846 INFO [Listener at localhost/44993] mob.MobFileCache(124): MobFileCache disabled 2023-09-21 08:01:19,847 INFO [Listener at localhost/44993] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-21 08:01:19,850 INFO [Listener at localhost/44993] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-21 08:01:19,853 INFO [Listener at localhost/44993] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43299 connecting to ZooKeeper ensemble=127.0.0.1:58708 2023-09-21 08:01:19,858 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:432990x0, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-21 08:01:19,859 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43299-0x100cd8126510002 connected 2023-09-21 08:01:19,859 DEBUG [Listener at localhost/44993] zookeeper.ZKUtil(164): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-21 08:01:19,860 DEBUG [Listener at localhost/44993] zookeeper.ZKUtil(164): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-21 08:01:19,861 DEBUG [Listener at localhost/44993] zookeeper.ZKUtil(164): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-21 08:01:19,865 DEBUG [Listener at localhost/44993] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43299 2023-09-21 08:01:19,865 DEBUG [Listener at localhost/44993] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43299 2023-09-21 08:01:19,865 DEBUG [Listener at localhost/44993] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43299 2023-09-21 08:01:19,867 DEBUG [Listener at localhost/44993] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43299 2023-09-21 08:01:19,868 DEBUG [Listener at localhost/44993] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43299 2023-09-21 08:01:19,881 INFO [Listener at localhost/44993] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-21 08:01:19,881 INFO [Listener at localhost/44993] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-21 08:01:19,881 INFO [Listener at localhost/44993] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-21 08:01:19,881 INFO [Listener at localhost/44993] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-21 08:01:19,881 INFO [Listener at localhost/44993] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-21 08:01:19,881 INFO [Listener at localhost/44993] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-21 08:01:19,881 INFO [Listener at localhost/44993] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-21 08:01:19,883 INFO [Listener at localhost/44993] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40677 2023-09-21 08:01:19,883 INFO [Listener at localhost/44993] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-21 08:01:19,884 INFO [Listener at localhost/44993] mob.MobFileCache(124): MobFileCache disabled 2023-09-21 08:01:19,885 INFO [Listener at localhost/44993] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-21 08:01:19,887 INFO [Listener at localhost/44993] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-21 08:01:19,888 INFO [Listener at localhost/44993] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40677 connecting to ZooKeeper ensemble=127.0.0.1:58708 2023-09-21 08:01:19,893 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:406770x0, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-21 08:01:19,895 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40677-0x100cd8126510003 connected 2023-09-21 08:01:19,895 DEBUG [Listener at localhost/44993] zookeeper.ZKUtil(164): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-21 08:01:19,896 DEBUG [Listener at localhost/44993] zookeeper.ZKUtil(164): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-21 08:01:19,897 DEBUG [Listener at localhost/44993] zookeeper.ZKUtil(164): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-21 08:01:19,901 DEBUG [Listener at localhost/44993] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40677 2023-09-21 08:01:19,901 DEBUG [Listener at localhost/44993] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40677 2023-09-21 08:01:19,902 DEBUG [Listener at localhost/44993] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40677 2023-09-21 08:01:19,902 DEBUG [Listener at localhost/44993] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40677 2023-09-21 08:01:19,905 DEBUG [Listener at localhost/44993] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40677 2023-09-21 08:01:19,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,34581,1695283278509 2023-09-21 08:01:19,920 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-21 08:01:19,922 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,34581,1695283278509 2023-09-21 08:01:19,944 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-21 08:01:19,944 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-21 08:01:19,944 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-21 08:01:19,944 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-21 08:01:19,946 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-21 08:01:19,947 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-21 08:01:19,949 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,34581,1695283278509 from backup master directory 2023-09-21 08:01:19,949 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-21 08:01:19,954 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,34581,1695283278509 2023-09-21 08:01:19,954 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-21 08:01:19,954 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-21 08:01:19,955 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,34581,1695283278509 2023-09-21 08:01:19,958 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-21 08:01:19,959 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-21 08:01:20,061 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/hbase.id with ID: 1b4320e2-007b-430d-95c3-2781a6e81386 2023-09-21 08:01:20,114 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-21 08:01:20,136 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-21 08:01:20,197 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x6b01da1c to 127.0.0.1:58708 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 08:01:20,232 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b7518bf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 08:01:20,258 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-21 08:01:20,260 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-21 08:01:20,280 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-21 08:01:20,280 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-21 08:01:20,282 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-21 08:01:20,287 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-21 08:01:20,288 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-21 08:01:20,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/MasterData/data/master/store-tmp 2023-09-21 08:01:20,365 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 08:01:20,365 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-21 08:01:20,365 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-21 08:01:20,366 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-21 08:01:20,366 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-21 08:01:20,366 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-21 08:01:20,366 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-21 08:01:20,366 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-21 08:01:20,368 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/MasterData/WALs/jenkins-hbase4.apache.org,34581,1695283278509 2023-09-21 08:01:20,392 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34581%2C1695283278509, suffix=, logDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/MasterData/WALs/jenkins-hbase4.apache.org,34581,1695283278509, archiveDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/MasterData/oldWALs, maxLogs=10 2023-09-21 08:01:20,452 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34519,DS-04344ddf-80cd-4861-ab82-f3516b203876,DISK] 2023-09-21 08:01:20,452 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40151,DS-91c81189-b3a7-43a3-97c6-67a032f525cc,DISK] 2023-09-21 08:01:20,452 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39685,DS-d85f642f-7d5d-4706-a3fd-6939df7da4d0,DISK] 2023-09-21 08:01:20,464 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-21 08:01:20,533 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/MasterData/WALs/jenkins-hbase4.apache.org,34581,1695283278509/jenkins-hbase4.apache.org%2C34581%2C1695283278509.1695283280404 2023-09-21 08:01:20,533 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40151,DS-91c81189-b3a7-43a3-97c6-67a032f525cc,DISK], DatanodeInfoWithStorage[127.0.0.1:39685,DS-d85f642f-7d5d-4706-a3fd-6939df7da4d0,DISK], DatanodeInfoWithStorage[127.0.0.1:34519,DS-04344ddf-80cd-4861-ab82-f3516b203876,DISK]] 2023-09-21 08:01:20,534 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-21 08:01:20,534 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 08:01:20,538 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-21 08:01:20,539 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-21 08:01:20,603 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-21 08:01:20,611 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-21 08:01:20,641 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-21 08:01:20,654 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 08:01:20,661 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-21 08:01:20,663 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-21 08:01:20,681 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-21 08:01:20,686 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-21 08:01:20,687 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75443251, jitterRate=0.12419204413890839}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-21 08:01:20,687 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-21 08:01:20,689 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-21 08:01:20,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-21 08:01:20,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-21 08:01:20,726 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-21 08:01:20,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-09-21 08:01:20,772 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 43 msec 2023-09-21 08:01:20,772 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-21 08:01:20,806 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-21 08:01:20,813 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-21 08:01:20,840 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-21 08:01:20,845 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-21 08:01:20,847 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-21 08:01:20,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-21 08:01:20,857 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-21 08:01:20,860 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-21 08:01:20,862 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-21 08:01:20,863 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-21 08:01:20,877 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-21 08:01:20,883 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-21 08:01:20,883 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-21 08:01:20,883 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-21 08:01:20,883 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-21 08:01:20,883 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-21 08:01:20,884 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,34581,1695283278509, sessionid=0x100cd8126510000, setting cluster-up flag (Was=false) 2023-09-21 08:01:20,901 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-21 08:01:20,909 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-21 08:01:20,911 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,34581,1695283278509 2023-09-21 08:01:20,917 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-21 08:01:20,923 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-21 08:01:20,924 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,34581,1695283278509 2023-09-21 08:01:20,928 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp 2023-09-21 08:01:21,005 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-21 08:01:21,010 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 08:01:21,010 INFO [RS:1;jenkins-hbase4:43299] regionserver.HRegionServer(951): ClusterId : 1b4320e2-007b-430d-95c3-2781a6e81386 2023-09-21 08:01:21,011 INFO [RS:0;jenkins-hbase4:36469] regionserver.HRegionServer(951): ClusterId : 1b4320e2-007b-430d-95c3-2781a6e81386 2023-09-21 08:01:21,011 INFO [RS:2;jenkins-hbase4:40677] regionserver.HRegionServer(951): ClusterId : 1b4320e2-007b-430d-95c3-2781a6e81386 2023-09-21 08:01:21,011 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-21 08:01:21,019 DEBUG [RS:2;jenkins-hbase4:40677] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-21 08:01:21,019 DEBUG [RS:0;jenkins-hbase4:36469] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-21 08:01:21,019 DEBUG [RS:1;jenkins-hbase4:43299] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-21 08:01:21,026 DEBUG [RS:0;jenkins-hbase4:36469] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-21 08:01:21,026 DEBUG [RS:1;jenkins-hbase4:43299] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-21 08:01:21,026 DEBUG [RS:2;jenkins-hbase4:40677] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-21 08:01:21,027 DEBUG [RS:1;jenkins-hbase4:43299] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-21 08:01:21,026 DEBUG [RS:0;jenkins-hbase4:36469] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-21 08:01:21,027 DEBUG [RS:2;jenkins-hbase4:40677] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-21 08:01:21,032 DEBUG [RS:1;jenkins-hbase4:43299] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-21 08:01:21,032 DEBUG [RS:2;jenkins-hbase4:40677] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-21 08:01:21,035 DEBUG [RS:0;jenkins-hbase4:36469] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-21 08:01:21,037 DEBUG [RS:1;jenkins-hbase4:43299] zookeeper.ReadOnlyZKClient(139): Connect 0x68ef6e10 to 127.0.0.1:58708 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 08:01:21,037 DEBUG [RS:0;jenkins-hbase4:36469] zookeeper.ReadOnlyZKClient(139): Connect 0x4959f279 to 127.0.0.1:58708 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 08:01:21,037 DEBUG [RS:2;jenkins-hbase4:40677] zookeeper.ReadOnlyZKClient(139): Connect 0x13afb71b to 127.0.0.1:58708 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 08:01:21,049 DEBUG [RS:1;jenkins-hbase4:43299] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66288d7d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 08:01:21,050 DEBUG [RS:0;jenkins-hbase4:36469] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@479e1522, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 08:01:21,050 DEBUG [RS:1;jenkins-hbase4:43299] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62170560, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-21 08:01:21,050 DEBUG [RS:0;jenkins-hbase4:36469] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@43a19909, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-21 08:01:21,052 DEBUG [RS:2;jenkins-hbase4:40677] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d685b1e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 08:01:21,052 DEBUG [RS:2;jenkins-hbase4:40677] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c555125, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-21 08:01:21,085 DEBUG [RS:1;jenkins-hbase4:43299] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:43299 2023-09-21 08:01:21,085 DEBUG [RS:0;jenkins-hbase4:36469] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:36469 2023-09-21 08:01:21,085 DEBUG [RS:2;jenkins-hbase4:40677] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:40677 2023-09-21 08:01:21,090 INFO [RS:2;jenkins-hbase4:40677] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-21 08:01:21,090 INFO [RS:1;jenkins-hbase4:43299] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-21 08:01:21,091 INFO [RS:1;jenkins-hbase4:43299] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-21 08:01:21,090 INFO [RS:0;jenkins-hbase4:36469] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-21 08:01:21,091 INFO [RS:0;jenkins-hbase4:36469] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-21 08:01:21,091 INFO [RS:2;jenkins-hbase4:40677] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-21 08:01:21,091 DEBUG [RS:0;jenkins-hbase4:36469] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-21 08:01:21,091 DEBUG [RS:2;jenkins-hbase4:40677] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-21 08:01:21,091 DEBUG [RS:1;jenkins-hbase4:43299] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-21 08:01:21,092 INFO [RS:0;jenkins-hbase4:36469] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 08:01:21,093 DEBUG [RS:0;jenkins-hbase4:36469] regionserver.HRegionServer(1022): About to register with Master. 2023-09-21 08:01:21,093 INFO [RS:2;jenkins-hbase4:40677] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 08:01:21,093 DEBUG [RS:2;jenkins-hbase4:40677] regionserver.HRegionServer(1022): About to register with Master. 2023-09-21 08:01:21,093 INFO [RS:1;jenkins-hbase4:43299] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 08:01:21,093 DEBUG [RS:1;jenkins-hbase4:43299] regionserver.HRegionServer(1022): About to register with Master. 2023-09-21 08:01:21,096 INFO [RS:2;jenkins-hbase4:40677] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,34581,1695283278509 with isa=jenkins-hbase4.apache.org/172.31.14.131:40677, startcode=1695283279880 2023-09-21 08:01:21,096 INFO [RS:1;jenkins-hbase4:43299] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,34581,1695283278509 with isa=jenkins-hbase4.apache.org/172.31.14.131:43299, startcode=1695283279840 2023-09-21 08:01:21,096 INFO [RS:0;jenkins-hbase4:36469] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,34581,1695283278509 with isa=jenkins-hbase4.apache.org/172.31.14.131:36469, startcode=1695283279785 2023-09-21 08:01:21,116 DEBUG [RS:0;jenkins-hbase4:36469] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-21 08:01:21,116 DEBUG [RS:2;jenkins-hbase4:40677] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-21 08:01:21,116 DEBUG [RS:1;jenkins-hbase4:43299] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-21 08:01:21,120 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-21 08:01:21,132 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-21 08:01:21,132 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-21 08:01:21,132 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-21 08:01:21,132 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-21 08:01:21,133 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-09-21 08:01:21,133 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 08:01:21,133 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-21 08:01:21,133 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 08:01:21,134 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1695283311134 2023-09-21 08:01:21,168 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-21 08:01:21,176 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-21 08:01:21,177 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-21 08:01:21,182 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-21 08:01:21,182 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-21 08:01:21,191 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-21 08:01:21,192 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-21 08:01:21,192 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-21 08:01:21,192 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-21 08:01:21,193 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-21 08:01:21,194 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-21 08:01:21,196 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-21 08:01:21,196 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-21 08:01:21,200 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-21 08:01:21,200 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59651, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-21 08:01:21,200 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33879, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-21 08:01:21,200 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42185, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-21 08:01:21,201 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-21 08:01:21,204 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695283281203,5,FailOnTimeoutGroup] 2023-09-21 08:01:21,206 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695283281204,5,FailOnTimeoutGroup] 2023-09-21 08:01:21,207 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-21 08:01:21,207 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-21 08:01:21,209 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-21 08:01:21,209 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-21 08:01:21,217 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34581] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:21,237 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-21 08:01:21,238 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-21 08:01:21,239 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52 2023-09-21 08:01:21,241 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34581] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:21,242 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34581] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:21,249 DEBUG [RS:2;jenkins-hbase4:40677] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52 2023-09-21 08:01:21,249 DEBUG [RS:0;jenkins-hbase4:36469] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52 2023-09-21 08:01:21,249 DEBUG [RS:1;jenkins-hbase4:43299] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52 2023-09-21 08:01:21,250 DEBUG [RS:0;jenkins-hbase4:36469] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42401 2023-09-21 08:01:21,250 DEBUG [RS:2;jenkins-hbase4:40677] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42401 2023-09-21 08:01:21,250 DEBUG [RS:0;jenkins-hbase4:36469] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-21 08:01:21,250 DEBUG [RS:1;jenkins-hbase4:43299] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42401 2023-09-21 08:01:21,250 DEBUG [RS:2;jenkins-hbase4:40677] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-21 08:01:21,250 DEBUG [RS:1;jenkins-hbase4:43299] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-21 08:01:21,263 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-21 08:01:21,264 DEBUG [RS:2;jenkins-hbase4:40677] zookeeper.ZKUtil(162): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:21,264 DEBUG [RS:0;jenkins-hbase4:36469] zookeeper.ZKUtil(162): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:21,264 WARN [RS:2;jenkins-hbase4:40677] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-21 08:01:21,265 DEBUG [RS:1;jenkins-hbase4:43299] zookeeper.ZKUtil(162): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:21,265 INFO [RS:2;jenkins-hbase4:40677] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-21 08:01:21,266 WARN [RS:1;jenkins-hbase4:43299] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-21 08:01:21,264 WARN [RS:0;jenkins-hbase4:36469] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-21 08:01:21,266 INFO [RS:1;jenkins-hbase4:43299] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-21 08:01:21,266 DEBUG [RS:2;jenkins-hbase4:40677] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/WALs/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:21,267 DEBUG [RS:1;jenkins-hbase4:43299] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/WALs/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:21,267 INFO [RS:0;jenkins-hbase4:36469] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-21 08:01:21,267 DEBUG [RS:0;jenkins-hbase4:36469] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/WALs/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:21,270 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43299,1695283279840] 2023-09-21 08:01:21,270 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36469,1695283279785] 2023-09-21 08:01:21,270 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40677,1695283279880] 2023-09-21 08:01:21,274 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 08:01:21,277 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-21 08:01:21,279 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/meta/1588230740/info 2023-09-21 08:01:21,280 DEBUG [RS:1;jenkins-hbase4:43299] zookeeper.ZKUtil(162): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:21,280 DEBUG [RS:0;jenkins-hbase4:36469] zookeeper.ZKUtil(162): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:21,280 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-21 08:01:21,280 DEBUG [RS:1;jenkins-hbase4:43299] zookeeper.ZKUtil(162): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:21,281 DEBUG [RS:0;jenkins-hbase4:36469] zookeeper.ZKUtil(162): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:21,281 DEBUG [RS:1;jenkins-hbase4:43299] zookeeper.ZKUtil(162): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:21,282 DEBUG [RS:0;jenkins-hbase4:36469] zookeeper.ZKUtil(162): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:21,282 DEBUG [RS:2;jenkins-hbase4:40677] zookeeper.ZKUtil(162): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:21,282 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 08:01:21,282 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-21 08:01:21,283 DEBUG [RS:2;jenkins-hbase4:40677] zookeeper.ZKUtil(162): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:21,283 DEBUG [RS:2;jenkins-hbase4:40677] zookeeper.ZKUtil(162): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:21,285 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/meta/1588230740/rep_barrier 2023-09-21 08:01:21,286 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-21 08:01:21,287 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 08:01:21,287 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-21 08:01:21,289 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/meta/1588230740/table 2023-09-21 08:01:21,290 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-21 08:01:21,291 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 08:01:21,293 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/meta/1588230740 2023-09-21 08:01:21,295 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/meta/1588230740 2023-09-21 08:01:21,296 DEBUG [RS:1;jenkins-hbase4:43299] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-21 08:01:21,296 DEBUG [RS:2;jenkins-hbase4:40677] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-21 08:01:21,296 DEBUG [RS:0;jenkins-hbase4:36469] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-21 08:01:21,300 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-21 08:01:21,304 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-21 08:01:21,310 INFO [RS:1;jenkins-hbase4:43299] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-21 08:01:21,310 INFO [RS:0;jenkins-hbase4:36469] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-21 08:01:21,310 INFO [RS:2;jenkins-hbase4:40677] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-21 08:01:21,312 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-21 08:01:21,313 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59984147, jitterRate=-0.10616655647754669}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-21 08:01:21,314 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-21 08:01:21,314 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-21 08:01:21,314 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-21 08:01:21,314 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-21 08:01:21,314 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-21 08:01:21,314 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-21 08:01:21,316 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-21 08:01:21,316 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-21 08:01:21,321 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-21 08:01:21,321 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-21 08:01:21,334 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-21 08:01:21,342 INFO [RS:0;jenkins-hbase4:36469] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-21 08:01:21,344 INFO [RS:1;jenkins-hbase4:43299] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-21 08:01:21,345 INFO [RS:2;jenkins-hbase4:40677] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-21 08:01:21,349 INFO [RS:0;jenkins-hbase4:36469] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-21 08:01:21,349 INFO [RS:2;jenkins-hbase4:40677] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-21 08:01:21,349 INFO [RS:0;jenkins-hbase4:36469] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-21 08:01:21,349 INFO [RS:1;jenkins-hbase4:43299] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-21 08:01:21,350 INFO [RS:2;jenkins-hbase4:40677] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-21 08:01:21,350 INFO [RS:1;jenkins-hbase4:43299] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-21 08:01:21,351 INFO [RS:0;jenkins-hbase4:36469] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-21 08:01:21,351 INFO [RS:2;jenkins-hbase4:40677] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-21 08:01:21,357 INFO [RS:1;jenkins-hbase4:43299] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-21 08:01:21,351 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-21 08:01:21,362 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-21 08:01:21,369 INFO [RS:1;jenkins-hbase4:43299] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-21 08:01:21,369 INFO [RS:0;jenkins-hbase4:36469] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-21 08:01:21,369 DEBUG [RS:1;jenkins-hbase4:43299] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 08:01:21,369 INFO [RS:2;jenkins-hbase4:40677] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-21 08:01:21,369 DEBUG [RS:1;jenkins-hbase4:43299] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 08:01:21,369 DEBUG [RS:0;jenkins-hbase4:36469] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 08:01:21,370 DEBUG [RS:1;jenkins-hbase4:43299] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 08:01:21,370 DEBUG [RS:2;jenkins-hbase4:40677] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 08:01:21,370 DEBUG [RS:1;jenkins-hbase4:43299] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 08:01:21,370 DEBUG [RS:0;jenkins-hbase4:36469] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 08:01:21,370 DEBUG [RS:1;jenkins-hbase4:43299] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 08:01:21,370 DEBUG [RS:2;jenkins-hbase4:40677] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 08:01:21,370 DEBUG [RS:1;jenkins-hbase4:43299] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-21 08:01:21,370 DEBUG [RS:2;jenkins-hbase4:40677] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 08:01:21,370 DEBUG [RS:1;jenkins-hbase4:43299] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 08:01:21,370 DEBUG [RS:2;jenkins-hbase4:40677] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 08:01:21,370 DEBUG [RS:0;jenkins-hbase4:36469] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 08:01:21,370 DEBUG [RS:2;jenkins-hbase4:40677] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 08:01:21,370 DEBUG [RS:0;jenkins-hbase4:36469] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 08:01:21,371 DEBUG [RS:2;jenkins-hbase4:40677] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-21 08:01:21,371 DEBUG [RS:0;jenkins-hbase4:36469] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 08:01:21,371 DEBUG [RS:2;jenkins-hbase4:40677] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 08:01:21,370 DEBUG [RS:1;jenkins-hbase4:43299] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 08:01:21,371 DEBUG [RS:2;jenkins-hbase4:40677] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 08:01:21,371 DEBUG [RS:0;jenkins-hbase4:36469] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-21 08:01:21,371 DEBUG [RS:2;jenkins-hbase4:40677] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 08:01:21,371 DEBUG [RS:1;jenkins-hbase4:43299] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 08:01:21,371 DEBUG [RS:2;jenkins-hbase4:40677] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 08:01:21,371 DEBUG [RS:1;jenkins-hbase4:43299] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 08:01:21,371 DEBUG [RS:0;jenkins-hbase4:36469] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 08:01:21,371 DEBUG [RS:0;jenkins-hbase4:36469] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 08:01:21,371 DEBUG [RS:0;jenkins-hbase4:36469] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 08:01:21,372 DEBUG [RS:0;jenkins-hbase4:36469] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-21 08:01:21,375 INFO [RS:2;jenkins-hbase4:40677] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-21 08:01:21,375 INFO [RS:2;jenkins-hbase4:40677] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-21 08:01:21,375 INFO [RS:2;jenkins-hbase4:40677] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-21 08:01:21,377 INFO [RS:0;jenkins-hbase4:36469] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-21 08:01:21,377 INFO [RS:0;jenkins-hbase4:36469] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-21 08:01:21,377 INFO [RS:0;jenkins-hbase4:36469] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-21 08:01:21,381 INFO [RS:1;jenkins-hbase4:43299] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-21 08:01:21,381 INFO [RS:1;jenkins-hbase4:43299] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-21 08:01:21,381 INFO [RS:1;jenkins-hbase4:43299] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-21 08:01:21,394 INFO [RS:2;jenkins-hbase4:40677] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-21 08:01:21,396 INFO [RS:0;jenkins-hbase4:36469] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-21 08:01:21,399 INFO [RS:0;jenkins-hbase4:36469] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36469,1695283279785-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-21 08:01:21,399 INFO [RS:2;jenkins-hbase4:40677] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40677,1695283279880-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-21 08:01:21,402 INFO [RS:1;jenkins-hbase4:43299] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-21 08:01:21,402 INFO [RS:1;jenkins-hbase4:43299] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43299,1695283279840-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-21 08:01:21,420 INFO [RS:2;jenkins-hbase4:40677] regionserver.Replication(203): jenkins-hbase4.apache.org,40677,1695283279880 started 2023-09-21 08:01:21,421 INFO [RS:2;jenkins-hbase4:40677] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,40677,1695283279880, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40677, sessionid=0x100cd8126510003 2023-09-21 08:01:21,421 DEBUG [RS:2;jenkins-hbase4:40677] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-21 08:01:21,421 DEBUG [RS:2;jenkins-hbase4:40677] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:21,421 DEBUG [RS:2;jenkins-hbase4:40677] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40677,1695283279880' 2023-09-21 08:01:21,421 DEBUG [RS:2;jenkins-hbase4:40677] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-21 08:01:21,422 DEBUG [RS:2;jenkins-hbase4:40677] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-21 08:01:21,422 INFO [RS:0;jenkins-hbase4:36469] regionserver.Replication(203): jenkins-hbase4.apache.org,36469,1695283279785 started 2023-09-21 08:01:21,422 INFO [RS:0;jenkins-hbase4:36469] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,36469,1695283279785, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36469, sessionid=0x100cd8126510001 2023-09-21 08:01:21,423 DEBUG [RS:2;jenkins-hbase4:40677] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-21 08:01:21,423 DEBUG [RS:2;jenkins-hbase4:40677] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-21 08:01:21,423 DEBUG [RS:2;jenkins-hbase4:40677] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:21,423 DEBUG [RS:2;jenkins-hbase4:40677] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40677,1695283279880' 2023-09-21 08:01:21,423 DEBUG [RS:2;jenkins-hbase4:40677] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:01:21,423 DEBUG [RS:2;jenkins-hbase4:40677] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:01:21,424 DEBUG [RS:2;jenkins-hbase4:40677] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-21 08:01:21,424 INFO [RS:2;jenkins-hbase4:40677] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-21 08:01:21,424 INFO [RS:2;jenkins-hbase4:40677] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-21 08:01:21,424 INFO [RS:1;jenkins-hbase4:43299] regionserver.Replication(203): jenkins-hbase4.apache.org,43299,1695283279840 started 2023-09-21 08:01:21,424 DEBUG [RS:0;jenkins-hbase4:36469] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-21 08:01:21,424 INFO [RS:1;jenkins-hbase4:43299] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,43299,1695283279840, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43299, sessionid=0x100cd8126510002 2023-09-21 08:01:21,424 DEBUG [RS:0;jenkins-hbase4:36469] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:21,425 DEBUG [RS:1;jenkins-hbase4:43299] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-21 08:01:21,425 DEBUG [RS:1;jenkins-hbase4:43299] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:21,425 DEBUG [RS:0;jenkins-hbase4:36469] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36469,1695283279785' 2023-09-21 08:01:21,425 DEBUG [RS:1;jenkins-hbase4:43299] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43299,1695283279840' 2023-09-21 08:01:21,426 DEBUG [RS:1;jenkins-hbase4:43299] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-21 08:01:21,426 DEBUG [RS:0;jenkins-hbase4:36469] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-21 08:01:21,426 DEBUG [RS:1;jenkins-hbase4:43299] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-21 08:01:21,426 DEBUG [RS:0;jenkins-hbase4:36469] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-21 08:01:21,427 DEBUG [RS:1;jenkins-hbase4:43299] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-21 08:01:21,427 DEBUG [RS:0;jenkins-hbase4:36469] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-21 08:01:21,427 DEBUG [RS:1;jenkins-hbase4:43299] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-21 08:01:21,427 DEBUG [RS:0;jenkins-hbase4:36469] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-21 08:01:21,427 DEBUG [RS:1;jenkins-hbase4:43299] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:21,428 DEBUG [RS:1;jenkins-hbase4:43299] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43299,1695283279840' 2023-09-21 08:01:21,428 DEBUG [RS:1;jenkins-hbase4:43299] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:01:21,428 DEBUG [RS:0;jenkins-hbase4:36469] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:21,428 DEBUG [RS:0;jenkins-hbase4:36469] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36469,1695283279785' 2023-09-21 08:01:21,428 DEBUG [RS:0;jenkins-hbase4:36469] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:01:21,428 DEBUG [RS:1;jenkins-hbase4:43299] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:01:21,428 DEBUG [RS:0;jenkins-hbase4:36469] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:01:21,429 DEBUG [RS:1;jenkins-hbase4:43299] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-21 08:01:21,429 INFO [RS:1;jenkins-hbase4:43299] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-21 08:01:21,429 INFO [RS:1;jenkins-hbase4:43299] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-21 08:01:21,429 DEBUG [RS:0;jenkins-hbase4:36469] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-21 08:01:21,430 INFO [RS:0;jenkins-hbase4:36469] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-21 08:01:21,430 INFO [RS:0;jenkins-hbase4:36469] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-21 08:01:21,514 DEBUG [jenkins-hbase4:34581] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-21 08:01:21,518 DEBUG [jenkins-hbase4:34581] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-21 08:01:21,524 DEBUG [jenkins-hbase4:34581] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-21 08:01:21,524 DEBUG [jenkins-hbase4:34581] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-21 08:01:21,524 DEBUG [jenkins-hbase4:34581] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-21 08:01:21,524 DEBUG [jenkins-hbase4:34581] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-21 08:01:21,527 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36469,1695283279785, state=OPENING 2023-09-21 08:01:21,535 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-21 08:01:21,536 INFO [RS:2;jenkins-hbase4:40677] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40677%2C1695283279880, suffix=, logDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/WALs/jenkins-hbase4.apache.org,40677,1695283279880, archiveDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/oldWALs, maxLogs=32 2023-09-21 08:01:21,536 INFO [RS:1;jenkins-hbase4:43299] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43299%2C1695283279840, suffix=, logDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/WALs/jenkins-hbase4.apache.org,43299,1695283279840, archiveDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/oldWALs, maxLogs=32 2023-09-21 08:01:21,536 INFO [RS:0;jenkins-hbase4:36469] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36469%2C1695283279785, suffix=, logDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/WALs/jenkins-hbase4.apache.org,36469,1695283279785, archiveDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/oldWALs, maxLogs=32 2023-09-21 08:01:21,538 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-21 08:01:21,539 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-21 08:01:21,544 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36469,1695283279785}] 2023-09-21 08:01:21,566 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39685,DS-d85f642f-7d5d-4706-a3fd-6939df7da4d0,DISK] 2023-09-21 08:01:21,566 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40151,DS-91c81189-b3a7-43a3-97c6-67a032f525cc,DISK] 2023-09-21 08:01:21,567 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34519,DS-04344ddf-80cd-4861-ab82-f3516b203876,DISK] 2023-09-21 08:01:21,569 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34519,DS-04344ddf-80cd-4861-ab82-f3516b203876,DISK] 2023-09-21 08:01:21,569 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40151,DS-91c81189-b3a7-43a3-97c6-67a032f525cc,DISK] 2023-09-21 08:01:21,573 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39685,DS-d85f642f-7d5d-4706-a3fd-6939df7da4d0,DISK] 2023-09-21 08:01:21,586 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39685,DS-d85f642f-7d5d-4706-a3fd-6939df7da4d0,DISK] 2023-09-21 08:01:21,586 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34519,DS-04344ddf-80cd-4861-ab82-f3516b203876,DISK] 2023-09-21 08:01:21,586 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40151,DS-91c81189-b3a7-43a3-97c6-67a032f525cc,DISK] 2023-09-21 08:01:21,613 INFO [RS:0;jenkins-hbase4:36469] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/WALs/jenkins-hbase4.apache.org,36469,1695283279785/jenkins-hbase4.apache.org%2C36469%2C1695283279785.1695283281543 2023-09-21 08:01:21,614 INFO [RS:1;jenkins-hbase4:43299] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/WALs/jenkins-hbase4.apache.org,43299,1695283279840/jenkins-hbase4.apache.org%2C43299%2C1695283279840.1695283281543 2023-09-21 08:01:21,614 DEBUG [RS:0;jenkins-hbase4:36469] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34519,DS-04344ddf-80cd-4861-ab82-f3516b203876,DISK], DatanodeInfoWithStorage[127.0.0.1:40151,DS-91c81189-b3a7-43a3-97c6-67a032f525cc,DISK], DatanodeInfoWithStorage[127.0.0.1:39685,DS-d85f642f-7d5d-4706-a3fd-6939df7da4d0,DISK]] 2023-09-21 08:01:21,614 INFO [RS:2;jenkins-hbase4:40677] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/WALs/jenkins-hbase4.apache.org,40677,1695283279880/jenkins-hbase4.apache.org%2C40677%2C1695283279880.1695283281542 2023-09-21 08:01:21,616 DEBUG [RS:1;jenkins-hbase4:43299] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39685,DS-d85f642f-7d5d-4706-a3fd-6939df7da4d0,DISK], DatanodeInfoWithStorage[127.0.0.1:40151,DS-91c81189-b3a7-43a3-97c6-67a032f525cc,DISK], DatanodeInfoWithStorage[127.0.0.1:34519,DS-04344ddf-80cd-4861-ab82-f3516b203876,DISK]] 2023-09-21 08:01:21,618 DEBUG [RS:2;jenkins-hbase4:40677] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39685,DS-d85f642f-7d5d-4706-a3fd-6939df7da4d0,DISK], DatanodeInfoWithStorage[127.0.0.1:34519,DS-04344ddf-80cd-4861-ab82-f3516b203876,DISK], DatanodeInfoWithStorage[127.0.0.1:40151,DS-91c81189-b3a7-43a3-97c6-67a032f525cc,DISK]] 2023-09-21 08:01:21,770 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:21,772 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-21 08:01:21,776 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37970, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-21 08:01:21,792 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-21 08:01:21,793 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-21 08:01:21,797 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36469%2C1695283279785.meta, suffix=.meta, logDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/WALs/jenkins-hbase4.apache.org,36469,1695283279785, archiveDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/oldWALs, maxLogs=32 2023-09-21 08:01:21,820 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34519,DS-04344ddf-80cd-4861-ab82-f3516b203876,DISK] 2023-09-21 08:01:21,821 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40151,DS-91c81189-b3a7-43a3-97c6-67a032f525cc,DISK] 2023-09-21 08:01:21,826 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39685,DS-d85f642f-7d5d-4706-a3fd-6939df7da4d0,DISK] 2023-09-21 08:01:21,835 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/WALs/jenkins-hbase4.apache.org,36469,1695283279785/jenkins-hbase4.apache.org%2C36469%2C1695283279785.meta.1695283281799.meta 2023-09-21 08:01:21,836 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34519,DS-04344ddf-80cd-4861-ab82-f3516b203876,DISK], DatanodeInfoWithStorage[127.0.0.1:40151,DS-91c81189-b3a7-43a3-97c6-67a032f525cc,DISK], DatanodeInfoWithStorage[127.0.0.1:39685,DS-d85f642f-7d5d-4706-a3fd-6939df7da4d0,DISK]] 2023-09-21 08:01:21,836 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-21 08:01:21,837 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-21 08:01:21,839 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 08:01:21,840 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-21 08:01:21,842 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-21 08:01:21,843 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-21 08:01:21,860 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-21 08:01:21,860 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 08:01:21,861 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-21 08:01:21,861 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-21 08:01:21,864 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-21 08:01:21,866 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/meta/1588230740/info 2023-09-21 08:01:21,866 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/meta/1588230740/info 2023-09-21 08:01:21,867 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-21 08:01:21,868 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 08:01:21,868 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-21 08:01:21,870 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/meta/1588230740/rep_barrier 2023-09-21 08:01:21,870 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/meta/1588230740/rep_barrier 2023-09-21 08:01:21,871 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-21 08:01:21,872 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 08:01:21,872 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-21 08:01:21,874 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/meta/1588230740/table 2023-09-21 08:01:21,874 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/meta/1588230740/table 2023-09-21 08:01:21,875 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-21 08:01:21,876 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 08:01:21,878 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/meta/1588230740 2023-09-21 08:01:21,882 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/meta/1588230740 2023-09-21 08:01:21,886 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-21 08:01:21,889 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-21 08:01:21,891 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65417661, jitterRate=-0.025200888514518738}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-21 08:01:21,894 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-21 08:01:21,907 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1695283281762 2023-09-21 08:01:21,927 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-21 08:01:21,928 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-21 08:01:21,928 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36469,1695283279785, state=OPEN 2023-09-21 08:01:21,931 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-21 08:01:21,932 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-21 08:01:21,936 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-21 08:01:21,937 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36469,1695283279785 in 388 msec 2023-09-21 08:01:21,942 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-21 08:01:21,942 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 604 msec 2023-09-21 08:01:21,948 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 924 msec 2023-09-21 08:01:21,948 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1695283281948, completionTime=-1 2023-09-21 08:01:21,948 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-21 08:01:21,948 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-21 08:01:22,022 DEBUG [hconnection-0x47a0dadd-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:01:22,025 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37972, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:01:22,047 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-21 08:01:22,047 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1695283342047 2023-09-21 08:01:22,047 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1695283402047 2023-09-21 08:01:22,048 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 99 msec 2023-09-21 08:01:22,079 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34581,1695283278509-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-21 08:01:22,079 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34581,1695283278509-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-21 08:01:22,079 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34581,1695283278509-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-21 08:01:22,081 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:34581, period=300000, unit=MILLISECONDS is enabled. 2023-09-21 08:01:22,081 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-21 08:01:22,089 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-21 08:01:22,096 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-21 08:01:22,098 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-21 08:01:22,108 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-21 08:01:22,111 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-21 08:01:22,114 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-21 08:01:22,142 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/hbase/namespace/d502557a9f79976923de1cd15733cc21 2023-09-21 08:01:22,145 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/hbase/namespace/d502557a9f79976923de1cd15733cc21 empty. 2023-09-21 08:01:22,146 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/hbase/namespace/d502557a9f79976923de1cd15733cc21 2023-09-21 08:01:22,146 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-21 08:01:22,188 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-21 08:01:22,190 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => d502557a9f79976923de1cd15733cc21, NAME => 'hbase:namespace,,1695283282097.d502557a9f79976923de1cd15733cc21.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp 2023-09-21 08:01:22,208 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695283282097.d502557a9f79976923de1cd15733cc21.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 08:01:22,208 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing d502557a9f79976923de1cd15733cc21, disabling compactions & flushes 2023-09-21 08:01:22,208 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695283282097.d502557a9f79976923de1cd15733cc21. 2023-09-21 08:01:22,208 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695283282097.d502557a9f79976923de1cd15733cc21. 2023-09-21 08:01:22,209 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695283282097.d502557a9f79976923de1cd15733cc21. after waiting 0 ms 2023-09-21 08:01:22,209 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695283282097.d502557a9f79976923de1cd15733cc21. 2023-09-21 08:01:22,209 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695283282097.d502557a9f79976923de1cd15733cc21. 2023-09-21 08:01:22,209 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for d502557a9f79976923de1cd15733cc21: 2023-09-21 08:01:22,214 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-21 08:01:22,231 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1695283282097.d502557a9f79976923de1cd15733cc21.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695283282217"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695283282217"}]},"ts":"1695283282217"} 2023-09-21 08:01:22,260 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-21 08:01:22,262 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-21 08:01:22,268 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695283282263"}]},"ts":"1695283282263"} 2023-09-21 08:01:22,272 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-21 08:01:22,277 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-21 08:01:22,279 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-21 08:01:22,279 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-21 08:01:22,279 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-21 08:01:22,279 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-21 08:01:22,281 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d502557a9f79976923de1cd15733cc21, ASSIGN}] 2023-09-21 08:01:22,285 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d502557a9f79976923de1cd15733cc21, ASSIGN 2023-09-21 08:01:22,287 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=d502557a9f79976923de1cd15733cc21, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40677,1695283279880; forceNewPlan=false, retain=false 2023-09-21 08:01:22,440 INFO [jenkins-hbase4:34581] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-21 08:01:22,441 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d502557a9f79976923de1cd15733cc21, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:22,441 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1695283282097.d502557a9f79976923de1cd15733cc21.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695283282441"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695283282441"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695283282441"}]},"ts":"1695283282441"} 2023-09-21 08:01:22,449 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure d502557a9f79976923de1cd15733cc21, server=jenkins-hbase4.apache.org,40677,1695283279880}] 2023-09-21 08:01:22,604 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:22,604 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-21 08:01:22,607 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33116, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-21 08:01:22,613 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1695283282097.d502557a9f79976923de1cd15733cc21. 2023-09-21 08:01:22,613 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d502557a9f79976923de1cd15733cc21, NAME => 'hbase:namespace,,1695283282097.d502557a9f79976923de1cd15733cc21.', STARTKEY => '', ENDKEY => ''} 2023-09-21 08:01:22,613 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1695283282097.d502557a9f79976923de1cd15733cc21. service=AccessControlService 2023-09-21 08:01:22,614 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 08:01:22,615 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace d502557a9f79976923de1cd15733cc21 2023-09-21 08:01:22,615 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695283282097.d502557a9f79976923de1cd15733cc21.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 08:01:22,615 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d502557a9f79976923de1cd15733cc21 2023-09-21 08:01:22,615 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d502557a9f79976923de1cd15733cc21 2023-09-21 08:01:22,617 INFO [StoreOpener-d502557a9f79976923de1cd15733cc21-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region d502557a9f79976923de1cd15733cc21 2023-09-21 08:01:22,619 DEBUG [StoreOpener-d502557a9f79976923de1cd15733cc21-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/namespace/d502557a9f79976923de1cd15733cc21/info 2023-09-21 08:01:22,620 DEBUG [StoreOpener-d502557a9f79976923de1cd15733cc21-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/namespace/d502557a9f79976923de1cd15733cc21/info 2023-09-21 08:01:22,620 INFO [StoreOpener-d502557a9f79976923de1cd15733cc21-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d502557a9f79976923de1cd15733cc21 columnFamilyName info 2023-09-21 08:01:22,621 INFO [StoreOpener-d502557a9f79976923de1cd15733cc21-1] regionserver.HStore(310): Store=d502557a9f79976923de1cd15733cc21/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 08:01:22,623 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/namespace/d502557a9f79976923de1cd15733cc21 2023-09-21 08:01:22,624 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/namespace/d502557a9f79976923de1cd15733cc21 2023-09-21 08:01:22,628 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d502557a9f79976923de1cd15733cc21 2023-09-21 08:01:22,631 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/namespace/d502557a9f79976923de1cd15733cc21/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-21 08:01:22,632 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d502557a9f79976923de1cd15733cc21; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67308849, jitterRate=0.0029800087213516235}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-21 08:01:22,632 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d502557a9f79976923de1cd15733cc21: 2023-09-21 08:01:22,635 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1695283282097.d502557a9f79976923de1cd15733cc21., pid=6, masterSystemTime=1695283282604 2023-09-21 08:01:22,640 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1695283282097.d502557a9f79976923de1cd15733cc21. 2023-09-21 08:01:22,640 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1695283282097.d502557a9f79976923de1cd15733cc21. 2023-09-21 08:01:22,642 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d502557a9f79976923de1cd15733cc21, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:22,642 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1695283282097.d502557a9f79976923de1cd15733cc21.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695283282641"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695283282641"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695283282641"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695283282641"}]},"ts":"1695283282641"} 2023-09-21 08:01:22,649 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-21 08:01:22,650 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure d502557a9f79976923de1cd15733cc21, server=jenkins-hbase4.apache.org,40677,1695283279880 in 197 msec 2023-09-21 08:01:22,653 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-21 08:01:22,654 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=d502557a9f79976923de1cd15733cc21, ASSIGN in 368 msec 2023-09-21 08:01:22,655 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-21 08:01:22,655 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695283282655"}]},"ts":"1695283282655"} 2023-09-21 08:01:22,658 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-21 08:01:22,661 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-21 08:01:22,664 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 562 msec 2023-09-21 08:01:22,710 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-21 08:01:22,712 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-21 08:01:22,712 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-21 08:01:22,734 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:01:22,736 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33120, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:01:22,749 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-21 08:01:22,767 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-21 08:01:22,774 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 32 msec 2023-09-21 08:01:22,783 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-21 08:01:22,796 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-21 08:01:22,801 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-09-21 08:01:22,810 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-21 08:01:22,813 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-21 08:01:22,814 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.858sec 2023-09-21 08:01:22,816 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-21 08:01:22,818 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-21 08:01:22,818 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-21 08:01:22,820 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34581,1695283278509-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-21 08:01:22,820 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34581,1695283278509-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-21 08:01:22,841 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-21 08:01:22,843 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-21 08:01:22,846 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-21 08:01:22,847 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-21 08:01:22,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-21 08:01:22,850 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/hbase/acl/4bd099c1707db82441334f05c99fc4cc 2023-09-21 08:01:22,851 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/hbase/acl/4bd099c1707db82441334f05c99fc4cc empty. 2023-09-21 08:01:22,854 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/hbase/acl/4bd099c1707db82441334f05c99fc4cc 2023-09-21 08:01:22,854 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-21 08:01:22,859 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-21 08:01:22,877 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-21 08:01:22,879 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4bd099c1707db82441334f05c99fc4cc, NAME => 'hbase:acl,,1695283282837.4bd099c1707db82441334f05c99fc4cc.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp 2023-09-21 08:01:22,902 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695283282837.4bd099c1707db82441334f05c99fc4cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 08:01:22,902 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 4bd099c1707db82441334f05c99fc4cc, disabling compactions & flushes 2023-09-21 08:01:22,902 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695283282837.4bd099c1707db82441334f05c99fc4cc. 2023-09-21 08:01:22,902 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695283282837.4bd099c1707db82441334f05c99fc4cc. 2023-09-21 08:01:22,902 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695283282837.4bd099c1707db82441334f05c99fc4cc. after waiting 0 ms 2023-09-21 08:01:22,902 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695283282837.4bd099c1707db82441334f05c99fc4cc. 2023-09-21 08:01:22,902 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1695283282837.4bd099c1707db82441334f05c99fc4cc. 2023-09-21 08:01:22,902 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 4bd099c1707db82441334f05c99fc4cc: 2023-09-21 08:01:22,906 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-21 08:01:22,908 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1695283282837.4bd099c1707db82441334f05c99fc4cc.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695283282908"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695283282908"}]},"ts":"1695283282908"} 2023-09-21 08:01:22,911 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-21 08:01:22,913 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-21 08:01:22,913 ERROR [Listener at localhost/44993] master.TableStateManager(95): Unable to get table hbase:acl state org.apache.hadoop.hbase.TableNotFoundException: No state found for hbase:acl at org.apache.hadoop.hbase.master.TableStateManager.getTableState(TableStateManager.java:155) at org.apache.hadoop.hbase.master.TableStateManager.isTableState(TableStateManager.java:92) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.isTableDisabled(AssignmentManager.java:419) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.getRegionStatesCount(AssignmentManager.java:2341) at org.apache.hadoop.hbase.master.HMaster.getClusterMetricsWithoutCoprocessor(HMaster.java:2616) at org.apache.hadoop.hbase.master.HMaster.getClusterMetrics(HMaster.java:2640) at org.apache.hadoop.hbase.master.HMaster.getClusterMetrics(HMaster.java:2633) at org.apache.hadoop.hbase.MiniHBaseCluster.getClusterMetrics(MiniHBaseCluster.java:710) at org.apache.hadoop.hbase.MiniHBaseCluster.(MiniHBaseCluster.java:111) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniHBaseCluster(HBaseTestingUtility.java:1131) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:1094) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:1048) at org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot.setUpBeforeClass(TestMobSecureExportSnapshot.java:55) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunBefores.invokeMethod(RunBefores.java:33) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) 2023-09-21 08:01:22,913 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695283282913"}]},"ts":"1695283282913"} 2023-09-21 08:01:22,916 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-21 08:01:22,919 DEBUG [Listener at localhost/44993] zookeeper.ReadOnlyZKClient(139): Connect 0x51038fe2 to 127.0.0.1:58708 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 08:01:22,922 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-21 08:01:22,924 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-21 08:01:22,924 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-21 08:01:22,924 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-21 08:01:22,924 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-21 08:01:22,924 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=4bd099c1707db82441334f05c99fc4cc, ASSIGN}] 2023-09-21 08:01:22,925 DEBUG [Listener at localhost/44993] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28ba846e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 08:01:22,927 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=4bd099c1707db82441334f05c99fc4cc, ASSIGN 2023-09-21 08:01:22,930 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=4bd099c1707db82441334f05c99fc4cc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43299,1695283279840; forceNewPlan=false, retain=false 2023-09-21 08:01:22,944 DEBUG [hconnection-0x1044170-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:01:22,956 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37974, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:01:22,959 INFO [Listener at localhost/44993] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,34581,1695283278509 2023-09-21 08:01:22,959 INFO [Listener at localhost/44993] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-21 08:01:22,959 INFO [Listener at localhost/44993] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/test.cache.data in system properties and HBase conf 2023-09-21 08:01:22,959 INFO [Listener at localhost/44993] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/hadoop.tmp.dir in system properties and HBase conf 2023-09-21 08:01:22,959 INFO [Listener at localhost/44993] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/hadoop.log.dir in system properties and HBase conf 2023-09-21 08:01:22,959 INFO [Listener at localhost/44993] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-21 08:01:22,959 INFO [Listener at localhost/44993] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-21 08:01:22,959 INFO [Listener at localhost/44993] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-21 08:01:22,959 INFO [Listener at localhost/44993] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-21 08:01:22,960 INFO [Listener at localhost/44993] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-21 08:01:22,960 INFO [Listener at localhost/44993] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-21 08:01:22,960 INFO [Listener at localhost/44993] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-21 08:01:22,960 INFO [Listener at localhost/44993] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-21 08:01:22,960 INFO [Listener at localhost/44993] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-21 08:01:22,960 INFO [Listener at localhost/44993] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-21 08:01:22,960 INFO [Listener at localhost/44993] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-21 08:01:22,960 INFO [Listener at localhost/44993] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-21 08:01:22,960 INFO [Listener at localhost/44993] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/nfs.dump.dir in system properties and HBase conf 2023-09-21 08:01:22,960 INFO [Listener at localhost/44993] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/java.io.tmpdir in system properties and HBase conf 2023-09-21 08:01:22,960 INFO [Listener at localhost/44993] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-21 08:01:22,960 INFO [Listener at localhost/44993] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-21 08:01:22,961 INFO [Listener at localhost/44993] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-21 08:01:22,964 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-21 08:01:23,080 INFO [jenkins-hbase4:34581] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-21 08:01:23,081 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=4bd099c1707db82441334f05c99fc4cc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:23,082 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1695283282837.4bd099c1707db82441334f05c99fc4cc.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695283283081"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695283283081"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695283283081"}]},"ts":"1695283283081"} 2023-09-21 08:01:23,086 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 4bd099c1707db82441334f05c99fc4cc, server=jenkins-hbase4.apache.org,43299,1695283279840}] 2023-09-21 08:01:23,165 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-21 08:01:23,241 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:23,242 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-21 08:01:23,246 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39312, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-21 08:01:23,253 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1695283282837.4bd099c1707db82441334f05c99fc4cc. 2023-09-21 08:01:23,253 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4bd099c1707db82441334f05c99fc4cc, NAME => 'hbase:acl,,1695283282837.4bd099c1707db82441334f05c99fc4cc.', STARTKEY => '', ENDKEY => ''} 2023-09-21 08:01:23,254 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1695283282837.4bd099c1707db82441334f05c99fc4cc. service=AccessControlService 2023-09-21 08:01:23,254 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 08:01:23,254 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 4bd099c1707db82441334f05c99fc4cc 2023-09-21 08:01:23,254 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695283282837.4bd099c1707db82441334f05c99fc4cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 08:01:23,255 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4bd099c1707db82441334f05c99fc4cc 2023-09-21 08:01:23,255 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4bd099c1707db82441334f05c99fc4cc 2023-09-21 08:01:23,257 INFO [StoreOpener-4bd099c1707db82441334f05c99fc4cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 4bd099c1707db82441334f05c99fc4cc 2023-09-21 08:01:23,260 DEBUG [StoreOpener-4bd099c1707db82441334f05c99fc4cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/acl/4bd099c1707db82441334f05c99fc4cc/l 2023-09-21 08:01:23,260 DEBUG [StoreOpener-4bd099c1707db82441334f05c99fc4cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/acl/4bd099c1707db82441334f05c99fc4cc/l 2023-09-21 08:01:23,260 INFO [StoreOpener-4bd099c1707db82441334f05c99fc4cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4bd099c1707db82441334f05c99fc4cc columnFamilyName l 2023-09-21 08:01:23,261 INFO [StoreOpener-4bd099c1707db82441334f05c99fc4cc-1] regionserver.HStore(310): Store=4bd099c1707db82441334f05c99fc4cc/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 08:01:23,264 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/acl/4bd099c1707db82441334f05c99fc4cc 2023-09-21 08:01:23,265 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/acl/4bd099c1707db82441334f05c99fc4cc 2023-09-21 08:01:23,269 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4bd099c1707db82441334f05c99fc4cc 2023-09-21 08:01:23,273 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/acl/4bd099c1707db82441334f05c99fc4cc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-21 08:01:23,274 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4bd099c1707db82441334f05c99fc4cc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73237789, jitterRate=0.09132809937000275}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-21 08:01:23,275 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4bd099c1707db82441334f05c99fc4cc: 2023-09-21 08:01:23,277 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1695283282837.4bd099c1707db82441334f05c99fc4cc., pid=11, masterSystemTime=1695283283241 2023-09-21 08:01:23,281 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1695283282837.4bd099c1707db82441334f05c99fc4cc. 2023-09-21 08:01:23,282 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1695283282837.4bd099c1707db82441334f05c99fc4cc. 2023-09-21 08:01:23,282 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=4bd099c1707db82441334f05c99fc4cc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:23,283 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1695283282837.4bd099c1707db82441334f05c99fc4cc.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695283283282"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695283283282"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695283283282"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695283283282"}]},"ts":"1695283283282"} 2023-09-21 08:01:23,291 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-21 08:01:23,291 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 4bd099c1707db82441334f05c99fc4cc, server=jenkins-hbase4.apache.org,43299,1695283279840 in 200 msec 2023-09-21 08:01:23,295 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-21 08:01:23,295 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=4bd099c1707db82441334f05c99fc4cc, ASSIGN in 367 msec 2023-09-21 08:01:23,297 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-21 08:01:23,297 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695283283297"}]},"ts":"1695283283297"} 2023-09-21 08:01:23,300 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-21 08:01:23,305 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-21 08:01:23,308 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 464 msec 2023-09-21 08:01:23,465 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-21 08:01:23,465 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-21 08:01:23,478 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-21 08:01:24,236 WARN [Thread-382] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-21 08:01:24,582 INFO [Thread-382] log.Slf4jLog(67): jetty-6.1.26 2023-09-21 08:01:24,589 INFO [Thread-382] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_40413_jobhistory____.3sz08t/webapp 2023-09-21 08:01:24,762 INFO [Thread-382] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-21 08:01:24,762 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-21 08:01:24,762 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-21 08:01:24,765 INFO [Thread-382] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-21 08:01:24,854 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-21 08:01:25,188 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-21 08:01:25,447 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-21 08:01:25,479 INFO [Thread-382] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:40413 2023-09-21 08:01:25,734 WARN [Listener at jenkins-hbase4.apache.org/36603] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-21 08:01:26,018 WARN [Listener at jenkins-hbase4.apache.org/36603] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-21 08:01:26,019 INFO [Listener at jenkins-hbase4.apache.org/36603] log.Slf4jLog(67): jetty-6.1.26 2023-09-21 08:01:26,026 INFO [Listener at jenkins-hbase4.apache.org/36603] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_42177_cluster____.aoca8f/webapp 2023-09-21 08:01:26,101 INFO [Listener at jenkins-hbase4.apache.org/36603] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-21 08:01:26,101 INFO [Listener at jenkins-hbase4.apache.org/36603] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-21 08:01:26,102 INFO [Listener at jenkins-hbase4.apache.org/36603] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-21 08:01:26,102 INFO [Listener at jenkins-hbase4.apache.org/36603] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-21 08:01:26,115 INFO [Listener at jenkins-hbase4.apache.org/36603] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-21 08:01:26,293 INFO [Listener at jenkins-hbase4.apache.org/36603] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-21 08:01:26,385 INFO [Listener at jenkins-hbase4.apache.org/36603] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-21 08:01:26,392 INFO [Listener at jenkins-hbase4.apache.org/36603] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:42177 2023-09-21 08:01:26,894 WARN [Listener at jenkins-hbase4.apache.org/40997] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-21 08:01:26,944 WARN [Listener at jenkins-hbase4.apache.org/40997] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-21 08:01:26,945 INFO [Listener at jenkins-hbase4.apache.org/40997] log.Slf4jLog(67): jetty-6.1.26 2023-09-21 08:01:26,953 INFO [Listener at jenkins-hbase4.apache.org/40997] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_45425_node____.47x018/webapp 2023-09-21 08:01:27,005 INFO [Listener at jenkins-hbase4.apache.org/40997] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-21 08:01:27,006 INFO [Listener at jenkins-hbase4.apache.org/40997] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-21 08:01:27,006 INFO [Listener at jenkins-hbase4.apache.org/40997] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-21 08:01:27,006 INFO [Listener at jenkins-hbase4.apache.org/40997] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-21 08:01:27,016 INFO [Listener at jenkins-hbase4.apache.org/40997] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-21 08:01:27,039 INFO [Listener at jenkins-hbase4.apache.org/40997] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-21 08:01:27,137 INFO [Listener at jenkins-hbase4.apache.org/40997] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-21 08:01:27,151 INFO [Listener at jenkins-hbase4.apache.org/40997] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:45425 2023-09-21 08:01:27,345 WARN [Listener at jenkins-hbase4.apache.org/40119] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-21 08:01:27,350 WARN [Listener at jenkins-hbase4.apache.org/40119] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-21 08:01:27,351 INFO [Listener at jenkins-hbase4.apache.org/40119] log.Slf4jLog(67): jetty-6.1.26 2023-09-21 08:01:27,361 INFO [Listener at jenkins-hbase4.apache.org/40119] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34373_node____pw0i4/webapp 2023-09-21 08:01:27,416 INFO [Listener at jenkins-hbase4.apache.org/40119] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-21 08:01:27,417 INFO [Listener at jenkins-hbase4.apache.org/40119] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-21 08:01:27,417 INFO [Listener at jenkins-hbase4.apache.org/40119] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-21 08:01:27,417 INFO [Listener at jenkins-hbase4.apache.org/40119] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-21 08:01:27,425 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-21 08:01:27,433 INFO [Listener at jenkins-hbase4.apache.org/40119] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-21 08:01:27,470 INFO [Listener at jenkins-hbase4.apache.org/40119] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-21 08:01:27,566 INFO [Listener at jenkins-hbase4.apache.org/40119] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-21 08:01:27,576 INFO [Listener at jenkins-hbase4.apache.org/40119] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34373 2023-09-21 08:01:27,595 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-21 08:01:27,599 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-21 08:01:27,600 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-21 08:01:27,615 INFO [Listener at jenkins-hbase4.apache.org/40119] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-21 08:01:27,617 INFO [Listener at jenkins-hbase4.apache.org/40119] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-21 08:01:27,683 INFO [Listener at jenkins-hbase4.apache.org/40119] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=709, OpenFileDescriptor=899, MaxFileDescriptor=60000, SystemLoadAverage=151, ProcessCount=164, AvailableMemoryMB=3427 2023-09-21 08:01:27,684 WARN [Listener at jenkins-hbase4.apache.org/40119] hbase.ResourceChecker(130): Thread=709 is superior to 500 2023-09-21 08:01:27,698 DEBUG [Listener at jenkins-hbase4.apache.org/40119] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-21 08:01:27,704 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33218, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-21 08:01:27,711 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-21 08:01:27,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-21 08:01:27,716 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-21 08:01:27,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-21 08:01:27,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-21 08:01:27,719 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-21 08:01:27,723 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportWithTargetName/4345bbd5d222419e158bcfd1e4087e21 2023-09-21 08:01:27,723 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportWithTargetName/f10637a43cfdbe7fa00a94d4a5a79495 2023-09-21 08:01:27,726 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportWithTargetName/4345bbd5d222419e158bcfd1e4087e21 empty. 2023-09-21 08:01:27,726 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportWithTargetName/f10637a43cfdbe7fa00a94d4a5a79495 empty. 2023-09-21 08:01:27,727 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportWithTargetName/4345bbd5d222419e158bcfd1e4087e21 2023-09-21 08:01:27,727 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportWithTargetName/f10637a43cfdbe7fa00a94d4a5a79495 2023-09-21 08:01:27,727 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-21 08:01:27,760 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-21 08:01:27,762 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4345bbd5d222419e158bcfd1e4087e21, NAME => 'testtb-testExportWithTargetName,,1695283287711.4345bbd5d222419e158bcfd1e4087e21.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp 2023-09-21 08:01:27,762 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => f10637a43cfdbe7fa00a94d4a5a79495, NAME => 'testtb-testExportWithTargetName,1,1695283287711.f10637a43cfdbe7fa00a94d4a5a79495.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp 2023-09-21 08:01:27,795 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695283287711.4345bbd5d222419e158bcfd1e4087e21.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 08:01:27,796 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 4345bbd5d222419e158bcfd1e4087e21, disabling compactions & flushes 2023-09-21 08:01:27,796 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695283287711.4345bbd5d222419e158bcfd1e4087e21. 2023-09-21 08:01:27,796 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695283287711.4345bbd5d222419e158bcfd1e4087e21. 2023-09-21 08:01:27,796 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695283287711.4345bbd5d222419e158bcfd1e4087e21. after waiting 0 ms 2023-09-21 08:01:27,796 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695283287711.4345bbd5d222419e158bcfd1e4087e21. 2023-09-21 08:01:27,796 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695283287711.4345bbd5d222419e158bcfd1e4087e21. 2023-09-21 08:01:27,797 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 4345bbd5d222419e158bcfd1e4087e21: 2023-09-21 08:01:27,800 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695283287711.f10637a43cfdbe7fa00a94d4a5a79495.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 08:01:27,800 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing f10637a43cfdbe7fa00a94d4a5a79495, disabling compactions & flushes 2023-09-21 08:01:27,801 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695283287711.f10637a43cfdbe7fa00a94d4a5a79495. 2023-09-21 08:01:27,801 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695283287711.f10637a43cfdbe7fa00a94d4a5a79495. 2023-09-21 08:01:27,801 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695283287711.f10637a43cfdbe7fa00a94d4a5a79495. after waiting 0 ms 2023-09-21 08:01:27,801 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695283287711.f10637a43cfdbe7fa00a94d4a5a79495. 2023-09-21 08:01:27,801 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695283287711.f10637a43cfdbe7fa00a94d4a5a79495. 2023-09-21 08:01:27,801 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for f10637a43cfdbe7fa00a94d4a5a79495: 2023-09-21 08:01:27,805 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-21 08:01:27,806 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695283287711.4345bbd5d222419e158bcfd1e4087e21.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695283287806"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695283287806"}]},"ts":"1695283287806"} 2023-09-21 08:01:27,806 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695283287711.f10637a43cfdbe7fa00a94d4a5a79495.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695283287806"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695283287806"}]},"ts":"1695283287806"} 2023-09-21 08:01:27,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-21 08:01:27,858 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-21 08:01:27,860 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-21 08:01:27,860 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695283287860"}]},"ts":"1695283287860"} 2023-09-21 08:01:27,862 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-21 08:01:27,868 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-21 08:01:27,870 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-21 08:01:27,870 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-21 08:01:27,870 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-21 08:01:27,870 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-21 08:01:27,870 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4345bbd5d222419e158bcfd1e4087e21, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f10637a43cfdbe7fa00a94d4a5a79495, ASSIGN}] 2023-09-21 08:01:27,873 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4345bbd5d222419e158bcfd1e4087e21, ASSIGN 2023-09-21 08:01:27,874 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f10637a43cfdbe7fa00a94d4a5a79495, ASSIGN 2023-09-21 08:01:27,875 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f10637a43cfdbe7fa00a94d4a5a79495, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40677,1695283279880; forceNewPlan=false, retain=false 2023-09-21 08:01:27,875 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4345bbd5d222419e158bcfd1e4087e21, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36469,1695283279785; forceNewPlan=false, retain=false 2023-09-21 08:01:28,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-21 08:01:28,025 INFO [jenkins-hbase4:34581] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-21 08:01:28,028 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=4345bbd5d222419e158bcfd1e4087e21, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:28,028 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=f10637a43cfdbe7fa00a94d4a5a79495, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:28,028 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695283287711.4345bbd5d222419e158bcfd1e4087e21.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695283288028"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695283288028"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695283288028"}]},"ts":"1695283288028"} 2023-09-21 08:01:28,028 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695283287711.f10637a43cfdbe7fa00a94d4a5a79495.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695283288028"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695283288028"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695283288028"}]},"ts":"1695283288028"} 2023-09-21 08:01:28,031 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 4345bbd5d222419e158bcfd1e4087e21, server=jenkins-hbase4.apache.org,36469,1695283279785}] 2023-09-21 08:01:28,032 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure f10637a43cfdbe7fa00a94d4a5a79495, server=jenkins-hbase4.apache.org,40677,1695283279880}] 2023-09-21 08:01:28,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1695283287711.f10637a43cfdbe7fa00a94d4a5a79495. 2023-09-21 08:01:28,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1695283287711.4345bbd5d222419e158bcfd1e4087e21. 2023-09-21 08:01:28,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f10637a43cfdbe7fa00a94d4a5a79495, NAME => 'testtb-testExportWithTargetName,1,1695283287711.f10637a43cfdbe7fa00a94d4a5a79495.', STARTKEY => '1', ENDKEY => ''} 2023-09-21 08:01:28,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4345bbd5d222419e158bcfd1e4087e21, NAME => 'testtb-testExportWithTargetName,,1695283287711.4345bbd5d222419e158bcfd1e4087e21.', STARTKEY => '', ENDKEY => '1'} 2023-09-21 08:01:28,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1695283287711.4345bbd5d222419e158bcfd1e4087e21. service=AccessControlService 2023-09-21 08:01:28,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1695283287711.f10637a43cfdbe7fa00a94d4a5a79495. service=AccessControlService 2023-09-21 08:01:28,195 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 08:01:28,195 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 08:01:28,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 4345bbd5d222419e158bcfd1e4087e21 2023-09-21 08:01:28,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName f10637a43cfdbe7fa00a94d4a5a79495 2023-09-21 08:01:28,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695283287711.4345bbd5d222419e158bcfd1e4087e21.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 08:01:28,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695283287711.f10637a43cfdbe7fa00a94d4a5a79495.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 08:01:28,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4345bbd5d222419e158bcfd1e4087e21 2023-09-21 08:01:28,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f10637a43cfdbe7fa00a94d4a5a79495 2023-09-21 08:01:28,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4345bbd5d222419e158bcfd1e4087e21 2023-09-21 08:01:28,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f10637a43cfdbe7fa00a94d4a5a79495 2023-09-21 08:01:28,199 INFO [StoreOpener-4345bbd5d222419e158bcfd1e4087e21-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4345bbd5d222419e158bcfd1e4087e21 2023-09-21 08:01:28,199 INFO [StoreOpener-f10637a43cfdbe7fa00a94d4a5a79495-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f10637a43cfdbe7fa00a94d4a5a79495 2023-09-21 08:01:28,201 DEBUG [StoreOpener-f10637a43cfdbe7fa00a94d4a5a79495-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportWithTargetName/f10637a43cfdbe7fa00a94d4a5a79495/cf 2023-09-21 08:01:28,201 DEBUG [StoreOpener-f10637a43cfdbe7fa00a94d4a5a79495-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportWithTargetName/f10637a43cfdbe7fa00a94d4a5a79495/cf 2023-09-21 08:01:28,201 DEBUG [StoreOpener-4345bbd5d222419e158bcfd1e4087e21-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportWithTargetName/4345bbd5d222419e158bcfd1e4087e21/cf 2023-09-21 08:01:28,201 DEBUG [StoreOpener-4345bbd5d222419e158bcfd1e4087e21-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportWithTargetName/4345bbd5d222419e158bcfd1e4087e21/cf 2023-09-21 08:01:28,205 INFO [StoreOpener-4345bbd5d222419e158bcfd1e4087e21-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4345bbd5d222419e158bcfd1e4087e21 columnFamilyName cf 2023-09-21 08:01:28,205 INFO [StoreOpener-f10637a43cfdbe7fa00a94d4a5a79495-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f10637a43cfdbe7fa00a94d4a5a79495 columnFamilyName cf 2023-09-21 08:01:28,208 INFO [StoreOpener-f10637a43cfdbe7fa00a94d4a5a79495-1] regionserver.HStore(310): Store=f10637a43cfdbe7fa00a94d4a5a79495/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 08:01:28,208 INFO [StoreOpener-4345bbd5d222419e158bcfd1e4087e21-1] regionserver.HStore(310): Store=4345bbd5d222419e158bcfd1e4087e21/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 08:01:28,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportWithTargetName/4345bbd5d222419e158bcfd1e4087e21 2023-09-21 08:01:28,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportWithTargetName/f10637a43cfdbe7fa00a94d4a5a79495 2023-09-21 08:01:28,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportWithTargetName/4345bbd5d222419e158bcfd1e4087e21 2023-09-21 08:01:28,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportWithTargetName/f10637a43cfdbe7fa00a94d4a5a79495 2023-09-21 08:01:28,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f10637a43cfdbe7fa00a94d4a5a79495 2023-09-21 08:01:28,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4345bbd5d222419e158bcfd1e4087e21 2023-09-21 08:01:28,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportWithTargetName/f10637a43cfdbe7fa00a94d4a5a79495/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-21 08:01:28,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportWithTargetName/4345bbd5d222419e158bcfd1e4087e21/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-21 08:01:28,229 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f10637a43cfdbe7fa00a94d4a5a79495; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65738843, jitterRate=-0.02041490375995636}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-21 08:01:28,229 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4345bbd5d222419e158bcfd1e4087e21; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64396428, jitterRate=-0.04041844606399536}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-21 08:01:28,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f10637a43cfdbe7fa00a94d4a5a79495: 2023-09-21 08:01:28,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4345bbd5d222419e158bcfd1e4087e21: 2023-09-21 08:01:28,231 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1695283287711.f10637a43cfdbe7fa00a94d4a5a79495., pid=16, masterSystemTime=1695283288184 2023-09-21 08:01:28,233 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1695283287711.4345bbd5d222419e158bcfd1e4087e21., pid=15, masterSystemTime=1695283288184 2023-09-21 08:01:28,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1695283287711.f10637a43cfdbe7fa00a94d4a5a79495. 2023-09-21 08:01:28,234 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1695283287711.f10637a43cfdbe7fa00a94d4a5a79495. 2023-09-21 08:01:28,235 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=f10637a43cfdbe7fa00a94d4a5a79495, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:28,235 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1695283287711.f10637a43cfdbe7fa00a94d4a5a79495.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695283288235"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695283288235"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695283288235"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695283288235"}]},"ts":"1695283288235"} 2023-09-21 08:01:28,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1695283287711.4345bbd5d222419e158bcfd1e4087e21. 2023-09-21 08:01:28,237 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1695283287711.4345bbd5d222419e158bcfd1e4087e21. 2023-09-21 08:01:28,237 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=4345bbd5d222419e158bcfd1e4087e21, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:28,239 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1695283287711.4345bbd5d222419e158bcfd1e4087e21.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695283288237"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695283288237"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695283288237"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695283288237"}]},"ts":"1695283288237"} 2023-09-21 08:01:28,245 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=14 2023-09-21 08:01:28,245 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure f10637a43cfdbe7fa00a94d4a5a79495, server=jenkins-hbase4.apache.org,40677,1695283279880 in 208 msec 2023-09-21 08:01:28,247 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=13 2023-09-21 08:01:28,252 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 4345bbd5d222419e158bcfd1e4087e21, server=jenkins-hbase4.apache.org,36469,1695283279785 in 211 msec 2023-09-21 08:01:28,253 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f10637a43cfdbe7fa00a94d4a5a79495, ASSIGN in 375 msec 2023-09-21 08:01:28,258 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=13, resume processing ppid=12 2023-09-21 08:01:28,258 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4345bbd5d222419e158bcfd1e4087e21, ASSIGN in 382 msec 2023-09-21 08:01:28,259 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-21 08:01:28,259 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695283288259"}]},"ts":"1695283288259"} 2023-09-21 08:01:28,261 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-21 08:01:28,265 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-21 08:01:28,271 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-21 08:01:28,278 DEBUG [PEWorker-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:01:28,281 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45744, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:01:28,287 DEBUG [hconnection-0x3631401b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:01:28,290 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42336, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2023-09-21 08:01:28,299 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43299] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-21 08:01:28,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-21 08:01:28,333 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-21 08:01:28,333 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-21 08:01:28,333 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-21 08:01:28,333 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-21 08:01:28,333 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-21 08:01:28,340 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-21 08:01:28,340 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-21 08:01:28,340 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-21 08:01:28,340 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-21 08:01:28,344 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 630 msec 2023-09-21 08:01:28,681 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 08:01:28,682 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-21 08:01:28,682 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 08:01:28,682 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-21 08:01:28,683 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-21 08:01:28,683 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-21 08:01:28,683 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 08:01:28,683 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-21 08:01:28,683 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-21 08:01:28,683 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-21 08:01:28,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-21 08:01:28,829 INFO [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-21 08:01:28,834 DEBUG [Listener at jenkins-hbase4.apache.org/40119] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-21 08:01:28,835 DEBUG [Listener at jenkins-hbase4.apache.org/40119] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695283287711.4345bbd5d222419e158bcfd1e4087e21. 2023-09-21 08:01:28,838 INFO [Listener at jenkins-hbase4.apache.org/40119] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-21 08:01:28,868 DEBUG [hconnection-0x1044170-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:01:28,873 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37568, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:01:28,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-21 08:01:28,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695283288892 (current time:1695283288892). 2023-09-21 08:01:28,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-21 08:01:28,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(139): Connect 0x097e4f92 to 127.0.0.1:58708 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 08:01:28,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a4ff13c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 08:01:28,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:01:28,905 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42350, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:01:28,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x097e4f92 to 127.0.0.1:58708 2023-09-21 08:01:28,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 08:01:28,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(139): Connect 0x0b900d76 to 127.0.0.1:58708 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 08:01:28,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@713c0427, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 08:01:28,917 DEBUG [hconnection-0x5470a3b9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:01:28,918 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42364, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:01:28,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:01:28,924 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45748, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:01:28,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b900d76 to 127.0.0.1:58708 2023-09-21 08:01:28,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 08:01:28,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-21 08:01:28,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-21 08:01:28,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-21 08:01:28,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-21 08:01:28,972 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-21 08:01:28,973 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695283888973 2023-09-21 08:01:28,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-21 08:01:28,974 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-21 08:01:28,977 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-21 08:01:28,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-21 08:01:28,979 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 14 msec 2023-09-21 08:01:28,981 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-21 08:01:28,981 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-21 08:01:28,982 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-21 08:01:28,982 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695283888982 2023-09-21 08:01:29,013 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,014 INFO [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-21 08:01:29,014 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:01:29,014 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-21 08:01:29,015 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-21 08:01:29,015 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,015 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,021 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:01:29,021 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:01:29,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:01:29,021 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:01:29,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:01:29,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:01:29,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:01:29,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:01:29,021 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:29,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:01:29,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,022 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:29,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,022 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:29,022 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,022 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,022 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,022 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:29,023 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-21 08:01:29,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-21 08:01:29,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-21 08:01:29,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-21 08:01:29,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,024 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-21 08:01:29,024 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-21 08:01:29,024 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-21 08:01:29,027 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,027 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,027 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,028 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-21 08:01:29,028 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-21 08:01:29,028 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-21 08:01:29,028 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:01:29,028 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:01:29,028 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:01:29,030 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-21 08:01:29,030 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-21 08:01:29,030 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-21 08:01:29,029 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-21 08:01:29,030 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43299,1695283279840' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-21 08:01:29,030 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-21 08:01:29,030 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-21 08:01:29,031 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40677,1695283279880' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-21 08:01:29,030 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36469,1695283279785' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-21 08:01:29,033 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,034 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:29,034 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:29,034 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,034 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:29,034 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,035 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 08:01:29,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:01:29,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:01:29,035 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,035 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 08:01:29,035 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,035 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 08:01:29,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:01:29,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:01:29,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:29,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:29,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:29,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:01:29,038 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36469,1695283279785' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-21 08:01:29,038 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b48e83b[Count = 1] remaining members to acquire global barrier 2023-09-21 08:01:29,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:29,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:01:29,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:01:29,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:01:29,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:01:29,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:29,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:29,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:29,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:01:29,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40677,1695283279880' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-21 08:01:29,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b48e83b[Count = 0] remaining members to acquire global barrier 2023-09-21 08:01:29,041 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-21 08:01:29,041 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,044 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,044 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,044 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,045 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-21 08:01:29,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,044 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:29,045 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-21 08:01:29,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,045 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-21 08:01:29,045 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-21 08:01:29,045 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43299,1695283279840' in zk 2023-09-21 08:01:29,045 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:29,045 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-21 08:01:29,046 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 08:01:29,046 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695283287711.4345bbd5d222419e158bcfd1e4087e21. 2023-09-21 08:01:29,046 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 08:01:29,046 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 08:01:29,046 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 08:01:29,046 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695283287711.f10637a43cfdbe7fa00a94d4a5a79495. 2023-09-21 08:01:29,047 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695283287711.4345bbd5d222419e158bcfd1e4087e21. started... 2023-09-21 08:01:29,047 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695283287711.f10637a43cfdbe7fa00a94d4a5a79495. started... 2023-09-21 08:01:29,049 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-21 08:01:29,049 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:01:29,049 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-21 08:01:29,052 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f10637a43cfdbe7fa00a94d4a5a79495: 2023-09-21 08:01:29,052 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4345bbd5d222419e158bcfd1e4087e21: 2023-09-21 08:01:29,053 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695283287711.f10637a43cfdbe7fa00a94d4a5a79495.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,053 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695283287711.4345bbd5d222419e158bcfd1e4087e21.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,059 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 08:01:29,059 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 08:01:29,062 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-21 08:01:29,062 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-21 08:01:29,082 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 08:01:29,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-21 08:01:29,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-21 08:01:29,101 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695283287711.f10637a43cfdbe7fa00a94d4a5a79495. completed. 2023-09-21 08:01:29,102 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695283287711.f10637a43cfdbe7fa00a94d4a5a79495. 2023-09-21 08:01:29,102 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-21 08:01:29,102 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695283287711.4345bbd5d222419e158bcfd1e4087e21. completed. 2023-09-21 08:01:29,102 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695283287711.4345bbd5d222419e158bcfd1e4087e21. 2023-09-21 08:01:29,102 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 08:01:29,102 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 08:01:29,102 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:29,102 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 08:01:29,102 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-21 08:01:29,102 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 08:01:29,102 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:29,102 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40677,1695283279880' in zk 2023-09-21 08:01:29,102 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-21 08:01:29,103 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,36469,1695283279785' in zk 2023-09-21 08:01:29,104 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-21 08:01:29,104 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-21 08:01:29,104 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:29,104 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:01:29,105 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:29,104 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:01:29,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:29,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:01:29,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:01:29,105 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-21 08:01:29,106 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-21 08:01:29,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:01:29,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:01:29,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:29,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:29,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:29,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:01:29,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:29,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:29,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:29,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40677,1695283279880': 2023-09-21 08:01:29,115 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40677,1695283279880' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-21 08:01:29,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:29,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:01:29,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:01:29,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:01:29,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:01:29,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:29,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:29,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:29,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:01:29,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:29,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:29,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:29,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,36469,1695283279785': 2023-09-21 08:01:29,120 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36469,1695283279785' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-21 08:01:29,120 INFO [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-21 08:01:29,120 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-21 08:01:29,120 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-21 08:01:29,120 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,120 INFO [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-21 08:01:29,123 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,123 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:01:29,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:01:29,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,123 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:01:29,123 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,123 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,123 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:01:29,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:01:29,123 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:01:29,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:01:29,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:01:29,124 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:29,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:01:29,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:01:29,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:01:29,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:01:29,125 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:29,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:01:29,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,125 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:29,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:29,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:29,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:29,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:01:29,128 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:29,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,128 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:29,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:29,128 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:29,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:29,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:29,143 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:01:29,143 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:01:29,143 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:01:29,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:01:29,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:01:29,144 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:01:29,143 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:29,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:01:29,144 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:01:29,144 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,143 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:01:29,143 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:01:29,145 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-21 08:01:29,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:01:29,144 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:01:29,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:01:29,145 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:29,145 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:29,145 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,145 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:29,145 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,145 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:29,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:01:29,145 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:01:29,146 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-21 08:01:29,145 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:29,146 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,146 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:01:29,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:01:29,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:01:29,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:01:29,147 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-21 08:01:29,166 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,169 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,225 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,227 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-21 08:01:29,227 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,228 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:29,228 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695283288974Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695283289166 (+192 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1695283289166Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1695283289166Writing data manifest for emptySnaptb0-testExportWithTargetName at 1695283289184 (+18 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1695283289213 (+29 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695283289227 (+14 ms) 2023-09-21 08:01:29,231 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-21 08:01:29,233 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 255 msec 2023-09-21 08:01:29,302 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 08:01:29,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-21 08:01:29,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-21 08:01:29,319 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36469] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1695283287711.4345bbd5d222419e158bcfd1e4087e21. with WAL disabled. Data may be lost in the event of a crash. 2023-09-21 08:01:29,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40677] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1695283287711.f10637a43cfdbe7fa00a94d4a5a79495. with WAL disabled. Data may be lost in the event of a crash. 2023-09-21 08:01:29,327 DEBUG [Listener at jenkins-hbase4.apache.org/40119] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-21 08:01:29,327 DEBUG [Listener at jenkins-hbase4.apache.org/40119] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695283287711.4345bbd5d222419e158bcfd1e4087e21. 2023-09-21 08:01:29,327 INFO [Listener at jenkins-hbase4.apache.org/40119] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-21 08:01:29,344 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-21 08:01:29,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695283289344 (current time:1695283289344). 2023-09-21 08:01:29,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-21 08:01:29,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(139): Connect 0x5afa4581 to 127.0.0.1:58708 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 08:01:29,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e05cb2b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 08:01:29,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:01:29,363 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42380, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:01:29,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5afa4581 to 127.0.0.1:58708 2023-09-21 08:01:29,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 08:01:29,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(139): Connect 0x67a144be to 127.0.0.1:58708 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 08:01:29,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f7fc386, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 08:01:29,373 DEBUG [hconnection-0xfc311d1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:01:29,376 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42392, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:01:29,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:01:29,385 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45752, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:01:29,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x67a144be to 127.0.0.1:58708 2023-09-21 08:01:29,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 08:01:29,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-21 08:01:29,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-21 08:01:29,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-21 08:01:29,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-21 08:01:29,393 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-21 08:01:29,394 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695283889394 2023-09-21 08:01:29,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-21 08:01:29,394 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-21 08:01:29,395 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-21 08:01:29,395 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-21 08:01:29,396 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-21 08:01:29,397 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-21 08:01:29,398 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 7 msec 2023-09-21 08:01:29,399 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-21 08:01:29,400 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695283889400 2023-09-21 08:01:29,420 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-21 08:01:29,420 INFO [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-21 08:01:29,420 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:01:29,422 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-21 08:01:29,422 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-21 08:01:29,422 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-21 08:01:29,422 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-21 08:01:29,424 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:01:29,425 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:01:29,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:01:29,425 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:01:29,425 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:29,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:01:29,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:01:29,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:01:29,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:01:29,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:01:29,425 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:29,425 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:29,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-21 08:01:29,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-21 08:01:29,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-21 08:01:29,426 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:29,426 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-21 08:01:29,426 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-21 08:01:29,426 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-21 08:01:29,426 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-21 08:01:29,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-21 08:01:29,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-21 08:01:29,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-21 08:01:29,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-21 08:01:29,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-21 08:01:29,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-21 08:01:29,427 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-21 08:01:29,427 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-21 08:01:29,427 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-21 08:01:29,427 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-21 08:01:29,427 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-21 08:01:29,427 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:01:29,429 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-21 08:01:29,429 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-21 08:01:29,429 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-21 08:01:29,429 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-21 08:01:29,430 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-21 08:01:29,430 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43299,1695283279840' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-21 08:01:29,429 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-21 08:01:29,430 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:01:29,430 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:01:29,431 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-21 08:01:29,432 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-21 08:01:29,432 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-21 08:01:29,432 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-21 08:01:29,432 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40677,1695283279880' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-21 08:01:29,432 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36469,1695283279785' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-21 08:01:29,434 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-21 08:01:29,435 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:29,435 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-21 08:01:29,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:29,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:01:29,435 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-21 08:01:29,435 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 08:01:29,435 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:29,435 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-21 08:01:29,435 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 08:01:29,435 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-21 08:01:29,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:01:29,436 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-21 08:01:29,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:01:29,436 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 08:01:29,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:01:29,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-21 08:01:29,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:29,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:29,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:29,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:01:29,438 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40677,1695283279880' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-21 08:01:29,438 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31191f32[Count = 1] remaining members to acquire global barrier 2023-09-21 08:01:29,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:29,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:01:29,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:01:29,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:01:29,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:01:29,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-21 08:01:29,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:29,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:29,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:29,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:01:29,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36469,1695283279785' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-21 08:01:29,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31191f32[Count = 0] remaining members to acquire global barrier 2023-09-21 08:01:29,441 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-21 08:01:29,441 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-21 08:01:29,446 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-21 08:01:29,446 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-21 08:01:29,446 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-21 08:01:29,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-21 08:01:29,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-21 08:01:29,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-21 08:01:29,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-21 08:01:29,446 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-21 08:01:29,446 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-21 08:01:29,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-21 08:01:29,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-21 08:01:29,446 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-21 08:01:29,446 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-21 08:01:29,446 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43299,1695283279840' in zk 2023-09-21 08:01:29,446 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:29,447 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 08:01:29,447 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 08:01:29,447 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695283287711.4345bbd5d222419e158bcfd1e4087e21. 2023-09-21 08:01:29,447 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 08:01:29,447 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 08:01:29,447 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695283287711.4345bbd5d222419e158bcfd1e4087e21. started... 2023-09-21 08:01:29,447 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:29,447 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-21 08:01:29,447 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695283287711.f10637a43cfdbe7fa00a94d4a5a79495. 2023-09-21 08:01:29,447 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695283287711.f10637a43cfdbe7fa00a94d4a5a79495. started... 2023-09-21 08:01:29,447 INFO [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4345bbd5d222419e158bcfd1e4087e21 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-21 08:01:29,447 INFO [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f10637a43cfdbe7fa00a94d4a5a79495 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-21 08:01:29,450 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-21 08:01:29,450 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:01:29,450 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-21 08:01:29,496 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 08:01:29,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-21 08:01:29,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-21 08:01:29,498 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-21 08:01:29,589 INFO [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230921d41e79efa233474ea59289e3874784e5 to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230921d41e79efa233474ea59289e3874784e5 2023-09-21 08:01:29,589 INFO [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309215c34b99333e340e08dcbe381a0cc1a96 to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309215c34b99333e340e08dcbe381a0cc1a96 2023-09-21 08:01:29,637 INFO [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportWithTargetName/4345bbd5d222419e158bcfd1e4087e21/.tmp/cf/7c7ad68ab7ff4300bc4f90b8785f5fa1 2023-09-21 08:01:29,639 INFO [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportWithTargetName/f10637a43cfdbe7fa00a94d4a5a79495/.tmp/cf/cd48fa7ba240474e949ccd6b34733855 2023-09-21 08:01:29,652 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportWithTargetName/f10637a43cfdbe7fa00a94d4a5a79495/.tmp/cf/cd48fa7ba240474e949ccd6b34733855 as hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportWithTargetName/f10637a43cfdbe7fa00a94d4a5a79495/cf/cd48fa7ba240474e949ccd6b34733855 2023-09-21 08:01:29,652 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportWithTargetName/4345bbd5d222419e158bcfd1e4087e21/.tmp/cf/7c7ad68ab7ff4300bc4f90b8785f5fa1 as hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportWithTargetName/4345bbd5d222419e158bcfd1e4087e21/cf/7c7ad68ab7ff4300bc4f90b8785f5fa1 2023-09-21 08:01:29,661 INFO [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportWithTargetName/f10637a43cfdbe7fa00a94d4a5a79495/cf/cd48fa7ba240474e949ccd6b34733855, entries=48, sequenceid=6, filesize=13.0 K 2023-09-21 08:01:29,661 INFO [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportWithTargetName/4345bbd5d222419e158bcfd1e4087e21/cf/7c7ad68ab7ff4300bc4f90b8785f5fa1, entries=2, sequenceid=6, filesize=5.2 K 2023-09-21 08:01:29,668 INFO [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 4345bbd5d222419e158bcfd1e4087e21 in 221ms, sequenceid=6, compaction requested=false 2023-09-21 08:01:29,668 INFO [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for f10637a43cfdbe7fa00a94d4a5a79495 in 221ms, sequenceid=6, compaction requested=false 2023-09-21 08:01:29,668 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-21 08:01:29,668 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-21 08:01:29,671 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4345bbd5d222419e158bcfd1e4087e21: 2023-09-21 08:01:29,671 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f10637a43cfdbe7fa00a94d4a5a79495: 2023-09-21 08:01:29,672 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695283287711.4345bbd5d222419e158bcfd1e4087e21.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-21 08:01:29,672 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695283287711.f10637a43cfdbe7fa00a94d4a5a79495.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-21 08:01:29,672 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 08:01:29,672 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 08:01:29,672 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportWithTargetName/f10637a43cfdbe7fa00a94d4a5a79495/cf/cd48fa7ba240474e949ccd6b34733855] hfiles 2023-09-21 08:01:29,672 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportWithTargetName/4345bbd5d222419e158bcfd1e4087e21/cf/7c7ad68ab7ff4300bc4f90b8785f5fa1] hfiles 2023-09-21 08:01:29,672 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportWithTargetName/f10637a43cfdbe7fa00a94d4a5a79495/cf/cd48fa7ba240474e949ccd6b34733855 for snapshot=snaptb0-testExportWithTargetName 2023-09-21 08:01:29,672 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportWithTargetName/4345bbd5d222419e158bcfd1e4087e21/cf/7c7ad68ab7ff4300bc4f90b8785f5fa1 for snapshot=snaptb0-testExportWithTargetName 2023-09-21 08:01:29,698 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 08:01:29,698 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695283287711.4345bbd5d222419e158bcfd1e4087e21. completed. 2023-09-21 08:01:29,698 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695283287711.4345bbd5d222419e158bcfd1e4087e21. 2023-09-21 08:01:29,699 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 08:01:29,699 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 08:01:29,699 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:29,699 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-21 08:01:29,699 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,36469,1695283279785' in zk 2023-09-21 08:01:29,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-21 08:01:29,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-21 08:01:29,700 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-21 08:01:29,702 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:29,702 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-21 08:01:29,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:29,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:01:29,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:01:29,702 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:01:29,703 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-21 08:01:29,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:01:29,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:01:29,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-21 08:01:29,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:29,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:29,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:29,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:01:29,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-21 08:01:29,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:29,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:29,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,36469,1695283279785': 2023-09-21 08:01:29,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36469,1695283279785' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-21 08:01:30,001 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 08:01:30,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-21 08:01:30,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-21 08:01:30,003 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-09-21 08:01:30,099 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695283287711.f10637a43cfdbe7fa00a94d4a5a79495. completed. 2023-09-21 08:01:30,099 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695283287711.f10637a43cfdbe7fa00a94d4a5a79495. 2023-09-21 08:01:30,099 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 08:01:30,099 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 08:01:30,099 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:30,100 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-21 08:01:30,100 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40677,1695283279880' in zk 2023-09-21 08:01:30,101 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:30,101 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-21 08:01:30,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:30,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:01:30,102 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:01:30,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:01:30,102 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-21 08:01:30,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:01:30,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:01:30,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-21 08:01:30,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:30,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:30,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:30,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:01:30,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-21 08:01:30,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:30,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:30,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:30,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40677,1695283279880': 2023-09-21 08:01:30,109 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40677,1695283279880' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-21 08:01:30,109 INFO [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-21 08:01:30,109 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-21 08:01:30,109 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-21 08:01:30,109 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-21 08:01:30,109 INFO [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-21 08:01:30,113 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-21 08:01:30,113 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-21 08:01:30,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-21 08:01:30,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-21 08:01:30,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-21 08:01:30,114 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:01:30,114 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:01:30,114 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-21 08:01:30,113 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-21 08:01:30,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-21 08:01:30,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-21 08:01:30,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:01:30,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:01:30,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:01:30,114 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:01:30,114 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:30,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-21 08:01:30,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:01:30,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-21 08:01:30,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:01:30,115 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:30,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:01:30,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-21 08:01:30,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:01:30,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:01:30,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:01:30,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-21 08:01:30,115 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:30,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-21 08:01:30,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-21 08:01:30,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:01:30,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-21 08:01:30,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:30,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:30,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:30,118 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:30,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:01:30,119 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:30,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-21 08:01:30,119 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:30,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:30,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:30,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:30,132 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:01:30,132 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:01:30,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:01:30,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:01:30,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:01:30,133 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:01:30,132 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:01:30,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:01:30,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:01:30,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:01:30,133 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:30,133 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:01:30,133 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:01:30,133 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-21 08:01:30,133 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:01:30,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:01:30,133 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:30,133 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-21 08:01:30,134 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:30,134 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-21 08:01:30,135 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-21 08:01:30,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:01:30,135 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-21 08:01:30,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:01:30,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:01:30,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:01:30,135 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-21 08:01:30,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:01:30,135 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:30,135 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-21 08:01:30,135 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:30,135 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:30,135 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-21 08:01:30,135 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-21 08:01:30,137 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309215c34b99333e340e08dcbe381a0cc1a96, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230921d41e79efa233474ea59289e3874784e5] mob files 2023-09-21 08:01:30,137 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309215c34b99333e340e08dcbe381a0cc1a96 2023-09-21 08:01:30,137 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230921d41e79efa233474ea59289e3874784e5 2023-09-21 08:01:30,156 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-21 08:01:30,157 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-21 08:01:30,196 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-21 08:01:30,197 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-21 08:01:30,197 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-21 08:01:30,198 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-21 08:01:30,198 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695283289394Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695283290156 (+762 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1695283290156Loading Region manifests for snaptb0-testExportWithTargetName at 1695283290156Writing data manifest for snaptb0-testExportWithTargetName at 1695283290162 (+6 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1695283290185 (+23 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695283290197 (+12 ms) 2023-09-21 08:01:30,200 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-21 08:01:30,204 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 806 msec 2023-09-21 08:01:30,503 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 08:01:30,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-21 08:01:30,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-21 08:01:30,507 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283290507 2023-09-21 08:01:30,507 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42401, tgtDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283290507, rawTgtDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283290507, srcFsUri=hdfs://localhost:42401, srcDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52 2023-09-21 08:01:30,546 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42401, inputRoot=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52 2023-09-21 08:01:30,546 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1239507706_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283290507, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283290507/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-21 08:01:30,546 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42401, inputRoot=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52, snapshotDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-21 08:01:30,567 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283290507/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-21 08:01:30,640 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-21 08:01:30,641 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-21 08:01:30,642 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-21 08:01:30,642 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-21 08:01:31,555 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/hadoop-6723437478874339923.jar 2023-09-21 08:01:31,555 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-21 08:01:31,556 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-21 08:01:31,625 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/hadoop-6033539545081965591.jar 2023-09-21 08:01:31,626 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-21 08:01:31,626 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-21 08:01:31,627 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-21 08:01:31,627 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-21 08:01:31,628 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-21 08:01:31,628 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-21 08:01:31,629 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-21 08:01:31,629 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-21 08:01:31,630 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-21 08:01:31,630 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-21 08:01:31,631 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-21 08:01:31,631 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-21 08:01:31,632 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-21 08:01:31,632 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-21 08:01:31,633 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-21 08:01:31,633 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-21 08:01:31,637 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 08:01:31,638 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 08:01:31,638 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-21 08:01:31,638 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 08:01:31,638 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 08:01:31,639 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-21 08:01:31,639 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-21 08:01:32,516 WARN [Listener at jenkins-hbase4.apache.org/40119] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-21 08:01:32,522 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-21 08:01:32,530 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-21 08:01:33,018 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-21 08:01:33,020 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-21 08:01:33,449 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695283286442_0001_000001 (auth:SIMPLE) 2023-09-21 08:01:33,700 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-21 08:01:38,026 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695283286442_0001_000001 (auth:SIMPLE) 2023-09-21 08:01:40,293 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695283286442_0001_000001 (auth:SIMPLE) 2023-09-21 08:01:43,018 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695283286442_0001_000001 (auth:SIMPLE) 2023-09-21 08:01:44,394 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-21 08:01:44,398 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-21 08:01:44,409 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-21 08:01:44,409 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-21 08:01:44,410 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-21 08:01:44,410 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-501182444_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-21 08:01:44,411 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(367): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-21 08:01:44,411 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(367): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-21 08:01:44,411 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-501182444_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283290507/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283290507/.hbase-snapshot/testExportWithTargetName 2023-09-21 08:01:44,411 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(367): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283290507/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-21 08:01:44,411 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(367): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283290507/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-21 08:01:44,423 INFO [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-21 08:01:44,428 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-09-21 08:01:44,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-21 08:01:44,443 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695283304443"}]},"ts":"1695283304443"} 2023-09-21 08:01:44,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-21 08:01:44,445 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-21 08:01:44,447 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-21 08:01:44,449 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4345bbd5d222419e158bcfd1e4087e21, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f10637a43cfdbe7fa00a94d4a5a79495, UNASSIGN}] 2023-09-21 08:01:44,452 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4345bbd5d222419e158bcfd1e4087e21, UNASSIGN 2023-09-21 08:01:44,452 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f10637a43cfdbe7fa00a94d4a5a79495, UNASSIGN 2023-09-21 08:01:44,453 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=4345bbd5d222419e158bcfd1e4087e21, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:44,453 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=f10637a43cfdbe7fa00a94d4a5a79495, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:44,453 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695283287711.4345bbd5d222419e158bcfd1e4087e21.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695283304453"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695283304453"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695283304453"}]},"ts":"1695283304453"} 2023-09-21 08:01:44,453 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695283287711.f10637a43cfdbe7fa00a94d4a5a79495.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695283304453"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695283304453"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695283304453"}]},"ts":"1695283304453"} 2023-09-21 08:01:44,456 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure f10637a43cfdbe7fa00a94d4a5a79495, server=jenkins-hbase4.apache.org,40677,1695283279880}] 2023-09-21 08:01:44,456 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure 4345bbd5d222419e158bcfd1e4087e21, server=jenkins-hbase4.apache.org,36469,1695283279785}] 2023-09-21 08:01:44,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-21 08:01:44,617 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4345bbd5d222419e158bcfd1e4087e21 2023-09-21 08:01:44,617 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f10637a43cfdbe7fa00a94d4a5a79495 2023-09-21 08:01:44,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4345bbd5d222419e158bcfd1e4087e21, disabling compactions & flushes 2023-09-21 08:01:44,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f10637a43cfdbe7fa00a94d4a5a79495, disabling compactions & flushes 2023-09-21 08:01:44,617 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695283287711.4345bbd5d222419e158bcfd1e4087e21. 2023-09-21 08:01:44,617 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695283287711.f10637a43cfdbe7fa00a94d4a5a79495. 2023-09-21 08:01:44,618 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695283287711.4345bbd5d222419e158bcfd1e4087e21. 2023-09-21 08:01:44,618 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695283287711.f10637a43cfdbe7fa00a94d4a5a79495. 2023-09-21 08:01:44,618 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695283287711.4345bbd5d222419e158bcfd1e4087e21. after waiting 0 ms 2023-09-21 08:01:44,618 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695283287711.f10637a43cfdbe7fa00a94d4a5a79495. after waiting 0 ms 2023-09-21 08:01:44,618 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695283287711.4345bbd5d222419e158bcfd1e4087e21. 2023-09-21 08:01:44,618 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695283287711.f10637a43cfdbe7fa00a94d4a5a79495. 2023-09-21 08:01:44,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportWithTargetName/4345bbd5d222419e158bcfd1e4087e21/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-21 08:01:44,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportWithTargetName/f10637a43cfdbe7fa00a94d4a5a79495/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-21 08:01:44,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 08:01:44,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 08:01:44,635 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695283287711.f10637a43cfdbe7fa00a94d4a5a79495. 2023-09-21 08:01:44,635 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695283287711.4345bbd5d222419e158bcfd1e4087e21. 2023-09-21 08:01:44,635 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f10637a43cfdbe7fa00a94d4a5a79495: 2023-09-21 08:01:44,635 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4345bbd5d222419e158bcfd1e4087e21: 2023-09-21 08:01:44,638 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f10637a43cfdbe7fa00a94d4a5a79495 2023-09-21 08:01:44,639 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=f10637a43cfdbe7fa00a94d4a5a79495, regionState=CLOSED 2023-09-21 08:01:44,639 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695283287711.f10637a43cfdbe7fa00a94d4a5a79495.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695283304638"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695283304638"}]},"ts":"1695283304638"} 2023-09-21 08:01:44,639 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4345bbd5d222419e158bcfd1e4087e21 2023-09-21 08:01:44,640 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=4345bbd5d222419e158bcfd1e4087e21, regionState=CLOSED 2023-09-21 08:01:44,640 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695283287711.4345bbd5d222419e158bcfd1e4087e21.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695283304640"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695283304640"}]},"ts":"1695283304640"} 2023-09-21 08:01:44,646 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-09-21 08:01:44,647 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure f10637a43cfdbe7fa00a94d4a5a79495, server=jenkins-hbase4.apache.org,40677,1695283279880 in 186 msec 2023-09-21 08:01:44,647 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=22 2023-09-21 08:01:44,647 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure 4345bbd5d222419e158bcfd1e4087e21, server=jenkins-hbase4.apache.org,36469,1695283279785 in 189 msec 2023-09-21 08:01:44,650 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f10637a43cfdbe7fa00a94d4a5a79495, UNASSIGN in 197 msec 2023-09-21 08:01:44,652 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=22, resume processing ppid=21 2023-09-21 08:01:44,652 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4345bbd5d222419e158bcfd1e4087e21, UNASSIGN in 198 msec 2023-09-21 08:01:44,653 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695283304653"}]},"ts":"1695283304653"} 2023-09-21 08:01:44,655 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-21 08:01:44,656 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-21 08:01:44,659 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 226 msec 2023-09-21 08:01:44,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-21 08:01:44,747 INFO [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-21 08:01:44,753 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-09-21 08:01:44,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-21 08:01:44,764 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-21 08:01:44,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-21 08:01:44,766 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-21 08:01:44,769 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43299] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-21 08:01:44,772 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportWithTargetName/4345bbd5d222419e158bcfd1e4087e21 2023-09-21 08:01:44,773 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportWithTargetName/f10637a43cfdbe7fa00a94d4a5a79495 2023-09-21 08:01:44,774 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-21 08:01:44,774 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-21 08:01:44,774 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-21 08:01:44,774 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-21 08:01:44,776 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:01:44,776 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:01:44,776 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-21 08:01:44,776 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-21 08:01:44,776 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:01:44,776 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-21 08:01:44,776 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-21 08:01:44,776 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-21 08:01:44,776 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-21 08:01:44,776 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-21 08:01:44,776 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-21 08:01:44,776 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:01:44,777 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportWithTargetName/4345bbd5d222419e158bcfd1e4087e21/cf, FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportWithTargetName/4345bbd5d222419e158bcfd1e4087e21/recovered.edits] 2023-09-21 08:01:44,777 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportWithTargetName/f10637a43cfdbe7fa00a94d4a5a79495/cf, FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportWithTargetName/f10637a43cfdbe7fa00a94d4a5a79495/recovered.edits] 2023-09-21 08:01:44,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-21 08:01:44,787 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportWithTargetName/f10637a43cfdbe7fa00a94d4a5a79495/cf/cd48fa7ba240474e949ccd6b34733855 to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/archive/data/default/testtb-testExportWithTargetName/f10637a43cfdbe7fa00a94d4a5a79495/cf/cd48fa7ba240474e949ccd6b34733855 2023-09-21 08:01:44,787 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportWithTargetName/4345bbd5d222419e158bcfd1e4087e21/cf/7c7ad68ab7ff4300bc4f90b8785f5fa1 to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/archive/data/default/testtb-testExportWithTargetName/4345bbd5d222419e158bcfd1e4087e21/cf/7c7ad68ab7ff4300bc4f90b8785f5fa1 2023-09-21 08:01:44,791 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportWithTargetName/4345bbd5d222419e158bcfd1e4087e21/recovered.edits/9.seqid to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/archive/data/default/testtb-testExportWithTargetName/4345bbd5d222419e158bcfd1e4087e21/recovered.edits/9.seqid 2023-09-21 08:01:44,791 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportWithTargetName/f10637a43cfdbe7fa00a94d4a5a79495/recovered.edits/9.seqid to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/archive/data/default/testtb-testExportWithTargetName/f10637a43cfdbe7fa00a94d4a5a79495/recovered.edits/9.seqid 2023-09-21 08:01:44,792 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportWithTargetName/4345bbd5d222419e158bcfd1e4087e21 2023-09-21 08:01:44,792 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportWithTargetName/f10637a43cfdbe7fa00a94d4a5a79495 2023-09-21 08:01:44,792 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-21 08:01:44,793 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-21 08:01:44,794 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-21 08:01:44,798 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309215c34b99333e340e08dcbe381a0cc1a96 to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309215c34b99333e340e08dcbe381a0cc1a96 2023-09-21 08:01:44,800 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230921d41e79efa233474ea59289e3874784e5 to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230921d41e79efa233474ea59289e3874784e5 2023-09-21 08:01:44,800 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-21 08:01:44,804 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-21 08:01:44,831 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-21 08:01:44,834 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-21 08:01:44,836 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-21 08:01:44,836 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-21 08:01:44,836 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1695283287711.4345bbd5d222419e158bcfd1e4087e21.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695283304836"}]},"ts":"9223372036854775807"} 2023-09-21 08:01:44,836 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1695283287711.f10637a43cfdbe7fa00a94d4a5a79495.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695283304836"}]},"ts":"9223372036854775807"} 2023-09-21 08:01:44,838 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-21 08:01:44,838 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4345bbd5d222419e158bcfd1e4087e21, NAME => 'testtb-testExportWithTargetName,,1695283287711.4345bbd5d222419e158bcfd1e4087e21.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f10637a43cfdbe7fa00a94d4a5a79495, NAME => 'testtb-testExportWithTargetName,1,1695283287711.f10637a43cfdbe7fa00a94d4a5a79495.', STARTKEY => '1', ENDKEY => ''}] 2023-09-21 08:01:44,838 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-21 08:01:44,839 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695283304839"}]},"ts":"9223372036854775807"} 2023-09-21 08:01:44,840 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-21 08:01:44,843 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-21 08:01:44,845 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 88 msec 2023-09-21 08:01:44,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-21 08:01:44,883 INFO [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-21 08:01:44,904 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-21 08:01:44,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-21 08:01:44,911 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-09-21 08:01:44,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-21 08:01:44,945 INFO [Listener at jenkins-hbase4.apache.org/40119] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=755 (was 709) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-501182444_17 at /127.0.0.1:33710 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x47a0dadd-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/cluster_a1516829-53a1-8a15-7b69-24c58f59b133/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x47a0dadd-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1104155582) connection to jenkins-hbase4.apache.org/172.31.14.131:40997 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x47a0dadd-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: Thread-1283 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (1104155582) connection to jenkins-hbase4.apache.org/172.31.14.131:44585 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/cluster_a1516829-53a1-8a15-7b69-24c58f59b133/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1104155582) connection to jenkins-hbase4.apache.org/172.31.14.131:40745 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/cluster_a1516829-53a1-8a15-7b69-24c58f59b133/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1209881769_1 at /127.0.0.1:39692 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-501182444_17 at /127.0.0.1:39714 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/cluster_a1516829-53a1-8a15-7b69-24c58f59b133/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/cluster_a1516829-53a1-8a15-7b69-24c58f59b133/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/cluster_a1516829-53a1-8a15-7b69-24c58f59b133/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-501182444_17 at /127.0.0.1:44948 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x47a0dadd-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=920 (was 899) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=178 (was 151) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 164) - ProcessCount LEAK? -, AvailableMemoryMB=2587 (was 3427) 2023-09-21 08:01:44,945 WARN [Listener at jenkins-hbase4.apache.org/40119] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-09-21 08:01:44,968 INFO [Listener at jenkins-hbase4.apache.org/40119] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=755, OpenFileDescriptor=920, MaxFileDescriptor=60000, SystemLoadAverage=178, ProcessCount=167, AvailableMemoryMB=2587 2023-09-21 08:01:44,968 WARN [Listener at jenkins-hbase4.apache.org/40119] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-09-21 08:01:44,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-21 08:01:44,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-21 08:01:44,979 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-21 08:01:44,980 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-21 08:01:44,981 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-21 08:01:44,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-21 08:01:44,984 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemState/b003816307774c187318a3d875f27966 2023-09-21 08:01:44,984 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemState/09d64ef43d820f98201455b18ccbb79b 2023-09-21 08:01:44,985 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemState/b003816307774c187318a3d875f27966 empty. 2023-09-21 08:01:44,985 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemState/09d64ef43d820f98201455b18ccbb79b empty. 2023-09-21 08:01:44,986 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemState/09d64ef43d820f98201455b18ccbb79b 2023-09-21 08:01:44,986 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemState/b003816307774c187318a3d875f27966 2023-09-21 08:01:44,986 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-21 08:01:45,002 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-21 08:01:45,003 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => b003816307774c187318a3d875f27966, NAME => 'testtb-testExportFileSystemState,,1695283304970.b003816307774c187318a3d875f27966.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp 2023-09-21 08:01:45,003 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 09d64ef43d820f98201455b18ccbb79b, NAME => 'testtb-testExportFileSystemState,1,1695283304970.09d64ef43d820f98201455b18ccbb79b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp 2023-09-21 08:01:45,034 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695283304970.b003816307774c187318a3d875f27966.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 08:01:45,035 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing b003816307774c187318a3d875f27966, disabling compactions & flushes 2023-09-21 08:01:45,035 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695283304970.b003816307774c187318a3d875f27966. 2023-09-21 08:01:45,035 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695283304970.09d64ef43d820f98201455b18ccbb79b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 08:01:45,035 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695283304970.b003816307774c187318a3d875f27966. 2023-09-21 08:01:45,036 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 09d64ef43d820f98201455b18ccbb79b, disabling compactions & flushes 2023-09-21 08:01:45,036 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695283304970.b003816307774c187318a3d875f27966. after waiting 0 ms 2023-09-21 08:01:45,036 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695283304970.09d64ef43d820f98201455b18ccbb79b. 2023-09-21 08:01:45,036 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695283304970.b003816307774c187318a3d875f27966. 2023-09-21 08:01:45,036 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695283304970.09d64ef43d820f98201455b18ccbb79b. 2023-09-21 08:01:45,036 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695283304970.b003816307774c187318a3d875f27966. 2023-09-21 08:01:45,037 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695283304970.09d64ef43d820f98201455b18ccbb79b. after waiting 0 ms 2023-09-21 08:01:45,037 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695283304970.09d64ef43d820f98201455b18ccbb79b. 2023-09-21 08:01:45,037 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695283304970.09d64ef43d820f98201455b18ccbb79b. 2023-09-21 08:01:45,037 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 09d64ef43d820f98201455b18ccbb79b: 2023-09-21 08:01:45,037 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for b003816307774c187318a3d875f27966: 2023-09-21 08:01:45,040 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-21 08:01:45,041 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695283304970.09d64ef43d820f98201455b18ccbb79b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695283305041"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695283305041"}]},"ts":"1695283305041"} 2023-09-21 08:01:45,041 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695283304970.b003816307774c187318a3d875f27966.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695283305041"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695283305041"}]},"ts":"1695283305041"} 2023-09-21 08:01:45,044 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-21 08:01:45,045 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-21 08:01:45,046 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695283305046"}]},"ts":"1695283305046"} 2023-09-21 08:01:45,047 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-21 08:01:45,056 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-21 08:01:45,058 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-21 08:01:45,058 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-21 08:01:45,058 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-21 08:01:45,058 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-21 08:01:45,058 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b003816307774c187318a3d875f27966, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=09d64ef43d820f98201455b18ccbb79b, ASSIGN}] 2023-09-21 08:01:45,062 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=09d64ef43d820f98201455b18ccbb79b, ASSIGN 2023-09-21 08:01:45,062 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b003816307774c187318a3d875f27966, ASSIGN 2023-09-21 08:01:45,063 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=09d64ef43d820f98201455b18ccbb79b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43299,1695283279840; forceNewPlan=false, retain=false 2023-09-21 08:01:45,063 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b003816307774c187318a3d875f27966, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36469,1695283279785; forceNewPlan=false, retain=false 2023-09-21 08:01:45,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-21 08:01:45,213 INFO [jenkins-hbase4:34581] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-21 08:01:45,216 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=09d64ef43d820f98201455b18ccbb79b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:45,216 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=b003816307774c187318a3d875f27966, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:45,216 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695283304970.09d64ef43d820f98201455b18ccbb79b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695283305216"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695283305216"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695283305216"}]},"ts":"1695283305216"} 2023-09-21 08:01:45,216 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695283304970.b003816307774c187318a3d875f27966.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695283305216"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695283305216"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695283305216"}]},"ts":"1695283305216"} 2023-09-21 08:01:45,219 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 09d64ef43d820f98201455b18ccbb79b, server=jenkins-hbase4.apache.org,43299,1695283279840}] 2023-09-21 08:01:45,220 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure b003816307774c187318a3d875f27966, server=jenkins-hbase4.apache.org,36469,1695283279785}] 2023-09-21 08:01:45,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-21 08:01:45,381 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1695283304970.b003816307774c187318a3d875f27966. 2023-09-21 08:01:45,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b003816307774c187318a3d875f27966, NAME => 'testtb-testExportFileSystemState,,1695283304970.b003816307774c187318a3d875f27966.', STARTKEY => '', ENDKEY => '1'} 2023-09-21 08:01:45,381 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1695283304970.09d64ef43d820f98201455b18ccbb79b. 2023-09-21 08:01:45,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 09d64ef43d820f98201455b18ccbb79b, NAME => 'testtb-testExportFileSystemState,1,1695283304970.09d64ef43d820f98201455b18ccbb79b.', STARTKEY => '1', ENDKEY => ''} 2023-09-21 08:01:45,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1695283304970.b003816307774c187318a3d875f27966. service=AccessControlService 2023-09-21 08:01:45,381 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 08:01:45,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState b003816307774c187318a3d875f27966 2023-09-21 08:01:45,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695283304970.b003816307774c187318a3d875f27966.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 08:01:45,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b003816307774c187318a3d875f27966 2023-09-21 08:01:45,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b003816307774c187318a3d875f27966 2023-09-21 08:01:45,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1695283304970.09d64ef43d820f98201455b18ccbb79b. service=AccessControlService 2023-09-21 08:01:45,382 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 08:01:45,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 09d64ef43d820f98201455b18ccbb79b 2023-09-21 08:01:45,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695283304970.09d64ef43d820f98201455b18ccbb79b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 08:01:45,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 09d64ef43d820f98201455b18ccbb79b 2023-09-21 08:01:45,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 09d64ef43d820f98201455b18ccbb79b 2023-09-21 08:01:45,383 INFO [StoreOpener-b003816307774c187318a3d875f27966-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b003816307774c187318a3d875f27966 2023-09-21 08:01:45,384 INFO [StoreOpener-09d64ef43d820f98201455b18ccbb79b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 09d64ef43d820f98201455b18ccbb79b 2023-09-21 08:01:45,385 DEBUG [StoreOpener-b003816307774c187318a3d875f27966-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemState/b003816307774c187318a3d875f27966/cf 2023-09-21 08:01:45,385 DEBUG [StoreOpener-b003816307774c187318a3d875f27966-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemState/b003816307774c187318a3d875f27966/cf 2023-09-21 08:01:45,385 DEBUG [StoreOpener-09d64ef43d820f98201455b18ccbb79b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemState/09d64ef43d820f98201455b18ccbb79b/cf 2023-09-21 08:01:45,385 DEBUG [StoreOpener-09d64ef43d820f98201455b18ccbb79b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemState/09d64ef43d820f98201455b18ccbb79b/cf 2023-09-21 08:01:45,385 INFO [StoreOpener-b003816307774c187318a3d875f27966-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b003816307774c187318a3d875f27966 columnFamilyName cf 2023-09-21 08:01:45,385 INFO [StoreOpener-09d64ef43d820f98201455b18ccbb79b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 09d64ef43d820f98201455b18ccbb79b columnFamilyName cf 2023-09-21 08:01:45,387 INFO [StoreOpener-b003816307774c187318a3d875f27966-1] regionserver.HStore(310): Store=b003816307774c187318a3d875f27966/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 08:01:45,388 INFO [StoreOpener-09d64ef43d820f98201455b18ccbb79b-1] regionserver.HStore(310): Store=09d64ef43d820f98201455b18ccbb79b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 08:01:45,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemState/b003816307774c187318a3d875f27966 2023-09-21 08:01:45,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemState/09d64ef43d820f98201455b18ccbb79b 2023-09-21 08:01:45,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemState/b003816307774c187318a3d875f27966 2023-09-21 08:01:45,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemState/09d64ef43d820f98201455b18ccbb79b 2023-09-21 08:01:45,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b003816307774c187318a3d875f27966 2023-09-21 08:01:45,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 09d64ef43d820f98201455b18ccbb79b 2023-09-21 08:01:45,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemState/09d64ef43d820f98201455b18ccbb79b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-21 08:01:45,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemState/b003816307774c187318a3d875f27966/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-21 08:01:45,397 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 09d64ef43d820f98201455b18ccbb79b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74967981, jitterRate=0.11710996925830841}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-21 08:01:45,397 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b003816307774c187318a3d875f27966; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59511005, jitterRate=-0.11321692168712616}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-21 08:01:45,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 09d64ef43d820f98201455b18ccbb79b: 2023-09-21 08:01:45,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b003816307774c187318a3d875f27966: 2023-09-21 08:01:45,398 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1695283304970.09d64ef43d820f98201455b18ccbb79b., pid=30, masterSystemTime=1695283305371 2023-09-21 08:01:45,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1695283304970.09d64ef43d820f98201455b18ccbb79b. 2023-09-21 08:01:45,400 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1695283304970.09d64ef43d820f98201455b18ccbb79b. 2023-09-21 08:01:45,401 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=09d64ef43d820f98201455b18ccbb79b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:45,401 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1695283304970.09d64ef43d820f98201455b18ccbb79b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695283305401"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695283305401"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695283305401"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695283305401"}]},"ts":"1695283305401"} 2023-09-21 08:01:45,405 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1695283304970.b003816307774c187318a3d875f27966., pid=31, masterSystemTime=1695283305374 2023-09-21 08:01:45,405 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=29 2023-09-21 08:01:45,409 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 09d64ef43d820f98201455b18ccbb79b, server=jenkins-hbase4.apache.org,43299,1695283279840 in 185 msec 2023-09-21 08:01:45,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1695283304970.b003816307774c187318a3d875f27966. 2023-09-21 08:01:45,410 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1695283304970.b003816307774c187318a3d875f27966. 2023-09-21 08:01:45,411 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=09d64ef43d820f98201455b18ccbb79b, ASSIGN in 351 msec 2023-09-21 08:01:45,411 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=b003816307774c187318a3d875f27966, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:45,411 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1695283304970.b003816307774c187318a3d875f27966.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695283305411"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695283305411"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695283305411"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695283305411"}]},"ts":"1695283305411"} 2023-09-21 08:01:45,415 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=28 2023-09-21 08:01:45,415 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure b003816307774c187318a3d875f27966, server=jenkins-hbase4.apache.org,36469,1695283279785 in 193 msec 2023-09-21 08:01:45,418 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=28, resume processing ppid=27 2023-09-21 08:01:45,418 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b003816307774c187318a3d875f27966, ASSIGN in 358 msec 2023-09-21 08:01:45,419 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-21 08:01:45,419 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695283305419"}]},"ts":"1695283305419"} 2023-09-21 08:01:45,420 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-21 08:01:45,424 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-21 08:01:45,424 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-21 08:01:45,427 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43299] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-21 08:01:45,428 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:01:45,428 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:01:45,428 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:01:45,428 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:01:45,430 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-21 08:01:45,430 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-21 08:01:45,430 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-21 08:01:45,431 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-21 08:01:45,432 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 457 msec 2023-09-21 08:01:45,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-21 08:01:45,587 INFO [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-21 08:01:45,590 DEBUG [Listener at jenkins-hbase4.apache.org/40119] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-21 08:01:45,590 DEBUG [Listener at jenkins-hbase4.apache.org/40119] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695283304970.b003816307774c187318a3d875f27966. 2023-09-21 08:01:45,592 INFO [Listener at jenkins-hbase4.apache.org/40119] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-21 08:01:45,603 DEBUG [hconnection-0x1044170-shared-pool-11] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:01:45,609 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57324, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:01:45,613 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-21 08:01:45,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695283305614 (current time:1695283305614). 2023-09-21 08:01:45,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-21 08:01:45,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(139): Connect 0x2ca05aaa to 127.0.0.1:58708 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 08:01:45,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@570b6c99, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 08:01:45,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:01:45,628 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47836, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:01:45,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2ca05aaa to 127.0.0.1:58708 2023-09-21 08:01:45,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 08:01:45,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(139): Connect 0x5b273b72 to 127.0.0.1:58708 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 08:01:45,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@757c5fb6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 08:01:45,639 DEBUG [hconnection-0x799f8a24-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:01:45,643 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47846, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:01:45,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:01:45,649 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57332, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:01:45,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5b273b72 to 127.0.0.1:58708 2023-09-21 08:01:45,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 08:01:45,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-21 08:01:45,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-21 08:01:45,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-21 08:01:45,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-21 08:01:45,657 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-21 08:01:45,658 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695283905658 2023-09-21 08:01:45,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-21 08:01:45,658 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-21 08:01:45,660 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-21 08:01:45,661 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-21 08:01:45,661 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-21 08:01:45,663 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-21 08:01:45,665 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-09-21 08:01:45,666 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-21 08:01:45,667 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695283905667 2023-09-21 08:01:45,684 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,684 INFO [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-21 08:01:45,684 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:01:45,686 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-21 08:01:45,686 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-21 08:01:45,686 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,686 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,693 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:01:45,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:01:45,693 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:01:45,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:01:45,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:01:45,693 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:45,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:01:45,693 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:01:45,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:01:45,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:01:45,694 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:45,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,694 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:45,695 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,695 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,695 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,695 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:45,695 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-21 08:01:45,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-21 08:01:45,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-21 08:01:45,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-21 08:01:45,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,695 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-21 08:01:45,695 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-21 08:01:45,695 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-21 08:01:45,696 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,696 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,696 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-21 08:01:45,696 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,696 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-21 08:01:45,696 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-21 08:01:45,696 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:01:45,696 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:01:45,696 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:01:45,698 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-21 08:01:45,698 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-21 08:01:45,698 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-21 08:01:45,698 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43299,1695283279840' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-21 08:01:45,698 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-21 08:01:45,698 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-21 08:01:45,698 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-21 08:01:45,698 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36469,1695283279785' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-21 08:01:45,698 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40677,1695283279880' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-21 08:01:45,700 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,700 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:45,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:45,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:01:45,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:01:45,705 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,705 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:45,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:01:45,705 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,706 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 08:01:45,705 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,706 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,706 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 08:01:45,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:01:45,706 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,706 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 08:01:45,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:45,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:45,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:45,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:01:45,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43299,1695283279840' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-21 08:01:45,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36fb8b88[Count = 1] remaining members to acquire global barrier 2023-09-21 08:01:45,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:45,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:01:45,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:01:45,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:01:45,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:01:45,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:45,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:45,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:45,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:01:45,711 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36469,1695283279785' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-21 08:01:45,711 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36fb8b88[Count = 0] remaining members to acquire global barrier 2023-09-21 08:01:45,711 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-21 08:01:45,711 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,713 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,713 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,713 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,714 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-21 08:01:45,714 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:45,714 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-21 08:01:45,714 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-21 08:01:45,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,714 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40677,1695283279880' in zk 2023-09-21 08:01:45,714 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-21 08:01:45,714 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 08:01:45,714 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 08:01:45,714 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695283304970.b003816307774c187318a3d875f27966. 2023-09-21 08:01:45,714 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695283304970.b003816307774c187318a3d875f27966. started... 2023-09-21 08:01:45,715 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:45,715 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-21 08:01:45,715 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b003816307774c187318a3d875f27966: 2023-09-21 08:01:45,715 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695283304970.b003816307774c187318a3d875f27966.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,715 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 08:01:45,715 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-21 08:01:45,716 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-21 08:01:45,716 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:01:45,716 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-21 08:01:45,718 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 08:01:45,719 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 08:01:45,719 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695283304970.09d64ef43d820f98201455b18ccbb79b. 2023-09-21 08:01:45,719 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695283304970.09d64ef43d820f98201455b18ccbb79b. started... 2023-09-21 08:01:45,721 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 09d64ef43d820f98201455b18ccbb79b: 2023-09-21 08:01:45,721 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695283304970.09d64ef43d820f98201455b18ccbb79b.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,721 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 08:01:45,721 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-21 08:01:45,753 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695283304970.09d64ef43d820f98201455b18ccbb79b. completed. 2023-09-21 08:01:45,753 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695283304970.b003816307774c187318a3d875f27966. completed. 2023-09-21 08:01:45,753 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695283304970.b003816307774c187318a3d875f27966. 2023-09-21 08:01:45,753 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695283304970.09d64ef43d820f98201455b18ccbb79b. 2023-09-21 08:01:45,753 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 08:01:45,753 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 08:01:45,753 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:45,753 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 08:01:45,753 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 08:01:45,753 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:45,753 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-21 08:01:45,753 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-21 08:01:45,753 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36469,1695283279785' in zk 2023-09-21 08:01:45,753 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43299,1695283279840' in zk 2023-09-21 08:01:45,755 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:45,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:45,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:01:45,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:01:45,755 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:45,756 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-21 08:01:45,756 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:01:45,755 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-21 08:01:45,756 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-21 08:01:45,758 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:01:45,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:01:45,758 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-21 08:01:45,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:01:45,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:45,761 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 08:01:45,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:45,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:45,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-21 08:01:45,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-21 08:01:45,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:01:45,762 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-21 08:01:45,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:45,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:45,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:45,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43299,1695283279840': 2023-09-21 08:01:45,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43299,1695283279840' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-21 08:01:45,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:45,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:01:45,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:01:45,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:01:45,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:01:45,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:45,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:45,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:45,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:01:45,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:45,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:45,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:45,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,36469,1695283279785': 2023-09-21 08:01:45,769 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36469,1695283279785' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-21 08:01:45,769 INFO [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-21 08:01:45,769 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-21 08:01:45,769 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-21 08:01:45,769 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,769 INFO [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-21 08:01:45,771 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,771 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,771 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:01:45,771 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,771 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,771 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:01:45,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:01:45,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:01:45,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,771 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:01:45,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:01:45,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:01:45,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:01:45,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:01:45,772 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:45,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:01:45,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:01:45,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:01:45,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,773 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:45,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,774 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:45,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:01:45,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:45,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:45,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:45,776 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:45,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:01:45,777 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:45,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,777 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:45,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:45,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:45,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:45,782 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:01:45,782 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:01:45,782 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:45,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:01:45,782 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:01:45,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:01:45,782 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:01:45,782 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:01:45,782 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,782 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:45,782 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:45,782 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,782 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:45,782 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,782 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:45,782 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:45,782 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,783 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,782 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:01:45,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:01:45,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:01:45,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:01:45,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:01:45,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:01:45,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:01:45,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:01:45,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:01:45,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:01:45,783 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,784 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-21 08:01:45,783 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:01:45,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:01:45,784 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-21 08:01:45,787 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-21 08:01:45,809 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,810 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,825 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-21 08:01:45,844 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,845 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-21 08:01:45,845 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,846 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-21 08:01:45,846 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695283305659Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695283305809 (+150 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1695283305809Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1695283305809Writing data manifest for emptySnaptb0-testExportFileSystemState at 1695283305816 (+7 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1695283305836 (+20 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695283305845 (+9 ms) 2023-09-21 08:01:45,849 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-21 08:01:45,851 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 189 msec 2023-09-21 08:01:45,962 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 08:01:45,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-21 08:01:45,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-21 08:01:45,968 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36469] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1695283304970.b003816307774c187318a3d875f27966. with WAL disabled. Data may be lost in the event of a crash. 2023-09-21 08:01:45,970 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1695283304970.09d64ef43d820f98201455b18ccbb79b. with WAL disabled. Data may be lost in the event of a crash. 2023-09-21 08:01:45,976 DEBUG [Listener at jenkins-hbase4.apache.org/40119] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-21 08:01:45,976 DEBUG [Listener at jenkins-hbase4.apache.org/40119] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695283304970.b003816307774c187318a3d875f27966. 2023-09-21 08:01:45,977 INFO [Listener at jenkins-hbase4.apache.org/40119] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-21 08:01:45,990 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-21 08:01:45,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695283305990 (current time:1695283305990). 2023-09-21 08:01:45,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-21 08:01:45,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(139): Connect 0x44152779 to 127.0.0.1:58708 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 08:01:45,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@43b40f72, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 08:01:46,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:01:46,003 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47848, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:01:46,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x44152779 to 127.0.0.1:58708 2023-09-21 08:01:46,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 08:01:46,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(139): Connect 0x67a2db62 to 127.0.0.1:58708 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 08:01:46,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@694d47b1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 08:01:46,017 DEBUG [hconnection-0x3657dddd-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:01:46,018 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47856, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:01:46,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:01:46,027 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57340, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:01:46,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x67a2db62 to 127.0.0.1:58708 2023-09-21 08:01:46,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 08:01:46,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-21 08:01:46,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-21 08:01:46,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-21 08:01:46,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-21 08:01:46,034 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-21 08:01:46,035 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695283906035 2023-09-21 08:01:46,035 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-21 08:01:46,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-21 08:01:46,037 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-21 08:01:46,037 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-21 08:01:46,038 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-21 08:01:46,038 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-21 08:01:46,040 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-09-21 08:01:46,041 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-21 08:01:46,042 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695283906042 2023-09-21 08:01:46,054 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-21 08:01:46,054 INFO [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-21 08:01:46,054 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:01:46,056 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-21 08:01:46,056 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-21 08:01:46,056 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,056 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,136 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:01:46,136 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:46,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:01:46,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:01:46,136 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:01:46,136 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:01:46,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:01:46,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:01:46,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:01:46,137 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:46,137 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:46,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,137 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 08:01:46,137 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:46,137 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-21 08:01:46,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:01:46,138 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,138 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-21 08:01:46,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,138 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-21 08:01:46,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-21 08:01:46,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-21 08:01:46,138 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-21 08:01:46,139 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-21 08:01:46,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-21 08:01:46,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,139 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-21 08:01:46,139 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-21 08:01:46,139 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-21 08:01:46,139 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-21 08:01:46,139 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-21 08:01:46,139 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-21 08:01:46,139 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:01:46,139 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:01:46,141 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-21 08:01:46,142 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-21 08:01:46,142 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-21 08:01:46,142 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40677,1695283279880' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-21 08:01:46,139 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-21 08:01:46,142 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-21 08:01:46,142 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36469,1695283279785' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-21 08:01:46,142 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-21 08:01:46,142 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:01:46,143 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-21 08:01:46,143 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-21 08:01:46,143 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43299,1695283279840' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-21 08:01:46,229 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,229 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:46,229 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:46,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:01:46,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:01:46,339 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 08:01:46,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-21 08:01:46,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-21 08:01:46,341 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-21 08:01:46,344 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:46,344 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,344 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 08:01:46,344 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:01:46,344 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,344 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 08:01:46,344 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:01:46,344 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 08:01:46,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-21 08:01:46,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:46,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:46,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:46,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:01:46,347 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36469,1695283279785' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-21 08:01:46,347 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4fe2f2ea[Count = 1] remaining members to acquire global barrier 2023-09-21 08:01:46,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:46,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:01:46,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:01:46,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:01:46,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:01:46,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-21 08:01:46,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:46,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:46,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:46,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:01:46,350 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43299,1695283279840' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-21 08:01:46,350 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4fe2f2ea[Count = 0] remaining members to acquire global barrier 2023-09-21 08:01:46,350 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-21 08:01:46,350 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,460 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,460 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,460 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,461 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:46,461 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-21 08:01:46,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,461 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-21 08:01:46,461 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 08:01:46,461 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 08:01:46,461 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695283304970.09d64ef43d820f98201455b18ccbb79b. 2023-09-21 08:01:46,461 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-21 08:01:46,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,461 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40677,1695283279880' in zk 2023-09-21 08:01:46,462 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-21 08:01:46,461 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695283304970.09d64ef43d820f98201455b18ccbb79b. started... 2023-09-21 08:01:46,461 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:46,462 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-21 08:01:46,462 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 08:01:46,462 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 08:01:46,462 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695283304970.b003816307774c187318a3d875f27966. 2023-09-21 08:01:46,462 INFO [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 09d64ef43d820f98201455b18ccbb79b 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-09-21 08:01:46,462 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695283304970.b003816307774c187318a3d875f27966. started... 2023-09-21 08:01:46,462 INFO [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b003816307774c187318a3d875f27966 1/1 column families, dataSize=333 B heapSize=976 B 2023-09-21 08:01:46,488 INFO [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230921429baae4dba24b3496577f246ea074df to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230921429baae4dba24b3496577f246ea074df 2023-09-21 08:01:46,497 INFO [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309214a20f3d874c84f878d96409b23049fc0 to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309214a20f3d874c84f878d96409b23049fc0 2023-09-21 08:01:46,501 INFO [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemState/09d64ef43d820f98201455b18ccbb79b/.tmp/cf/65599b965d2641dda99a346d8f14a3c6 2023-09-21 08:01:46,509 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemState/09d64ef43d820f98201455b18ccbb79b/.tmp/cf/65599b965d2641dda99a346d8f14a3c6 as hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemState/09d64ef43d820f98201455b18ccbb79b/cf/65599b965d2641dda99a346d8f14a3c6 2023-09-21 08:01:46,509 INFO [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemState/b003816307774c187318a3d875f27966/.tmp/cf/1db6c651b8f5460694e8c874d029682d 2023-09-21 08:01:46,515 INFO [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemState/09d64ef43d820f98201455b18ccbb79b/cf/65599b965d2641dda99a346d8f14a3c6, entries=45, sequenceid=6, filesize=12.5 K 2023-09-21 08:01:46,516 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemState/b003816307774c187318a3d875f27966/.tmp/cf/1db6c651b8f5460694e8c874d029682d as hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemState/b003816307774c187318a3d875f27966/cf/1db6c651b8f5460694e8c874d029682d 2023-09-21 08:01:46,517 INFO [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 09d64ef43d820f98201455b18ccbb79b in 55ms, sequenceid=6, compaction requested=false 2023-09-21 08:01:46,518 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 09d64ef43d820f98201455b18ccbb79b: 2023-09-21 08:01:46,519 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695283304970.09d64ef43d820f98201455b18ccbb79b.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-21 08:01:46,519 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 08:01:46,519 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemState/09d64ef43d820f98201455b18ccbb79b/cf/65599b965d2641dda99a346d8f14a3c6] hfiles 2023-09-21 08:01:46,519 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemState/09d64ef43d820f98201455b18ccbb79b/cf/65599b965d2641dda99a346d8f14a3c6 for snapshot=snaptb0-testExportFileSystemState 2023-09-21 08:01:46,526 INFO [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemState/b003816307774c187318a3d875f27966/cf/1db6c651b8f5460694e8c874d029682d, entries=5, sequenceid=6, filesize=5.7 K 2023-09-21 08:01:46,533 INFO [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for b003816307774c187318a3d875f27966 in 70ms, sequenceid=6, compaction requested=false 2023-09-21 08:01:46,533 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b003816307774c187318a3d875f27966: 2023-09-21 08:01:46,533 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695283304970.b003816307774c187318a3d875f27966.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-21 08:01:46,533 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 08:01:46,533 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemState/b003816307774c187318a3d875f27966/cf/1db6c651b8f5460694e8c874d029682d] hfiles 2023-09-21 08:01:46,533 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemState/b003816307774c187318a3d875f27966/cf/1db6c651b8f5460694e8c874d029682d for snapshot=snaptb0-testExportFileSystemState 2023-09-21 08:01:46,541 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695283304970.09d64ef43d820f98201455b18ccbb79b. completed. 2023-09-21 08:01:46,541 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695283304970.09d64ef43d820f98201455b18ccbb79b. 2023-09-21 08:01:46,541 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 08:01:46,541 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 08:01:46,541 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:46,541 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-21 08:01:46,541 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43299,1695283279840' in zk 2023-09-21 08:01:46,550 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695283304970.b003816307774c187318a3d875f27966. completed. 2023-09-21 08:01:46,550 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695283304970.b003816307774c187318a3d875f27966. 2023-09-21 08:01:46,550 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 08:01:46,550 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 08:01:46,550 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:46,551 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-21 08:01:46,551 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36469,1695283279785' in zk 2023-09-21 08:01:46,559 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-21 08:01:46,559 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:01:46,559 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-21 08:01:46,641 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 08:01:46,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-21 08:01:46,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-21 08:01:46,643 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-09-21 08:01:46,753 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-21 08:01:46,753 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:46,753 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-21 08:01:46,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:46,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:01:46,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:01:46,754 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:01:46,753 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:46,753 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:01:46,754 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-21 08:01:46,755 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-21 08:01:46,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:01:46,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:01:46,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-21 08:01:46,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:46,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:46,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:46,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:01:46,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-21 08:01:46,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:46,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:46,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:46,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,36469,1695283279785': 2023-09-21 08:01:46,761 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36469,1695283279785' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-21 08:01:46,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:46,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:01:46,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:01:46,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:01:46,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:01:46,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-21 08:01:46,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:46,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:46,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:46,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:01:46,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-21 08:01:46,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:46,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:46,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:46,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43299,1695283279840': 2023-09-21 08:01:46,765 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43299,1695283279840' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-21 08:01:46,765 INFO [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-21 08:01:46,765 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-21 08:01:46,765 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-21 08:01:46,765 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-21 08:01:46,765 INFO [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-21 08:01:46,813 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,813 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,813 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,813 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,814 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:01:46,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:01:46,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:01:46,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,813 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:01:46,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,813 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:01:46,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:01:46,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:01:46,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:01:46,814 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:46,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:01:46,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:01:46,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:01:46,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:01:46,815 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:46,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-21 08:01:46,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:01:46,815 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:46,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-21 08:01:46,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:46,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:46,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:46,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:01:46,817 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:46,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-21 08:01:46,818 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:46,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:46,818 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:46,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:46,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:46,869 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:01:46,869 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:01:46,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:01:46,870 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:01:46,870 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-21 08:01:46,869 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:46,870 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-21 08:01:46,869 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:01:46,870 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:01:46,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:01:46,870 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:01:46,870 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:01:46,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:01:46,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:01:46,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:01:46,870 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-21 08:01:46,870 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:46,870 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:01:46,872 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:46,872 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,872 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-21 08:01:46,872 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:01:46,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:01:46,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:01:46,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:01:46,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:01:46,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:01:46,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:01:46,872 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,873 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:01:46,873 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:01:46,873 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,873 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,874 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230921429baae4dba24b3496577f246ea074df, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309214a20f3d874c84f878d96409b23049fc0] mob files 2023-09-21 08:01:46,874 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230921429baae4dba24b3496577f246ea074df 2023-09-21 08:01:46,874 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309214a20f3d874c84f878d96409b23049fc0 2023-09-21 08:01:46,886 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-21 08:01:46,887 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,915 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,916 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-21 08:01:46,916 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,916 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-21 08:01:46,916 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695283306035Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695283306886 (+851 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1695283306886Loading Region manifests for snaptb0-testExportFileSystemState at 1695283306886Writing data manifest for snaptb0-testExportFileSystemState at 1695283306891 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1695283306906 (+15 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695283306916 (+10 ms) 2023-09-21 08:01:46,919 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-21 08:01:46,921 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 883 msec 2023-09-21 08:01:47,143 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 08:01:47,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-21 08:01:47,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-21 08:01:47,145 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283307145 2023-09-21 08:01:47,145 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42401, tgtDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283307145, rawTgtDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283307145, srcFsUri=hdfs://localhost:42401, srcDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52 2023-09-21 08:01:47,175 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42401, inputRoot=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52 2023-09-21 08:01:47,176 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1139420562_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283307145, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283307145/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-21 08:01:47,176 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42401, inputRoot=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52, snapshotDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-21 08:01:47,200 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283307145/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-21 08:01:47,230 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-21 08:01:47,231 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-21 08:01:47,231 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-21 08:01:47,231 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-21 08:01:48,122 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/hadoop-5269632441378376198.jar 2023-09-21 08:01:48,122 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-21 08:01:48,123 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-21 08:01:48,190 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/hadoop-396385444612269480.jar 2023-09-21 08:01:48,190 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-21 08:01:48,191 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-21 08:01:48,191 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-21 08:01:48,191 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-21 08:01:48,192 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-21 08:01:48,192 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-21 08:01:48,193 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-21 08:01:48,193 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-21 08:01:48,193 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-21 08:01:48,194 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-21 08:01:48,194 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-21 08:01:48,195 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-21 08:01:48,195 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-21 08:01:48,195 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-21 08:01:48,196 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-21 08:01:48,196 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-21 08:01:48,197 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 08:01:48,197 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 08:01:48,198 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-21 08:01:48,198 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 08:01:48,198 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 08:01:48,199 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-21 08:01:48,199 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-21 08:01:48,698 WARN [Listener at jenkins-hbase4.apache.org/40119] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-21 08:01:48,701 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-21 08:01:48,704 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-21 08:01:49,223 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-21 08:01:49,223 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-21 08:01:49,228 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695283286442_0001_000001 (auth:SIMPLE) 2023-09-21 08:01:49,639 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695283286442_0002_000001 (auth:SIMPLE) 2023-09-21 08:01:50,246 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-21 08:01:54,018 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695283286442_0002_000001 (auth:SIMPLE) 2023-09-21 08:01:56,259 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695283286442_0002_000001 (auth:SIMPLE) 2023-09-21 08:01:59,457 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695283286442_0002_000001 (auth:SIMPLE) 2023-09-21 08:02:00,927 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-21 08:02:00,928 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-21 08:02:00,936 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-21 08:02:00,937 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-21 08:02:00,937 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-21 08:02:00,937 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-501182444_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-21 08:02:00,938 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(367): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-21 08:02:00,938 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(367): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-21 08:02:00,938 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-501182444_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283307145/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283307145/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-21 08:02:00,939 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(367): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283307145/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-21 08:02:00,939 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(367): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283307145/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-21 08:02:00,946 INFO [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-21 08:02:00,946 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-09-21 08:02:00,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-21 08:02:00,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-21 08:02:00,952 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695283320952"}]},"ts":"1695283320952"} 2023-09-21 08:02:00,953 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-21 08:02:00,956 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-21 08:02:00,957 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b003816307774c187318a3d875f27966, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=09d64ef43d820f98201455b18ccbb79b, UNASSIGN}] 2023-09-21 08:02:00,959 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b003816307774c187318a3d875f27966, UNASSIGN 2023-09-21 08:02:00,959 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=09d64ef43d820f98201455b18ccbb79b, UNASSIGN 2023-09-21 08:02:00,960 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=b003816307774c187318a3d875f27966, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:00,960 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=09d64ef43d820f98201455b18ccbb79b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:00,960 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695283304970.b003816307774c187318a3d875f27966.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695283320960"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695283320960"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695283320960"}]},"ts":"1695283320960"} 2023-09-21 08:02:00,960 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695283304970.09d64ef43d820f98201455b18ccbb79b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695283320960"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695283320960"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695283320960"}]},"ts":"1695283320960"} 2023-09-21 08:02:00,962 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure b003816307774c187318a3d875f27966, server=jenkins-hbase4.apache.org,36469,1695283279785}] 2023-09-21 08:02:00,962 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 09d64ef43d820f98201455b18ccbb79b, server=jenkins-hbase4.apache.org,43299,1695283279840}] 2023-09-21 08:02:01,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-21 08:02:01,114 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b003816307774c187318a3d875f27966 2023-09-21 08:02:01,115 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 09d64ef43d820f98201455b18ccbb79b 2023-09-21 08:02:01,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b003816307774c187318a3d875f27966, disabling compactions & flushes 2023-09-21 08:02:01,115 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695283304970.b003816307774c187318a3d875f27966. 2023-09-21 08:02:01,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 09d64ef43d820f98201455b18ccbb79b, disabling compactions & flushes 2023-09-21 08:02:01,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695283304970.b003816307774c187318a3d875f27966. 2023-09-21 08:02:01,115 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695283304970.09d64ef43d820f98201455b18ccbb79b. 2023-09-21 08:02:01,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695283304970.b003816307774c187318a3d875f27966. after waiting 0 ms 2023-09-21 08:02:01,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695283304970.b003816307774c187318a3d875f27966. 2023-09-21 08:02:01,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695283304970.09d64ef43d820f98201455b18ccbb79b. 2023-09-21 08:02:01,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695283304970.09d64ef43d820f98201455b18ccbb79b. after waiting 0 ms 2023-09-21 08:02:01,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695283304970.09d64ef43d820f98201455b18ccbb79b. 2023-09-21 08:02:01,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemState/b003816307774c187318a3d875f27966/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-21 08:02:01,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemState/09d64ef43d820f98201455b18ccbb79b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-21 08:02:01,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 08:02:01,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 08:02:01,125 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695283304970.b003816307774c187318a3d875f27966. 2023-09-21 08:02:01,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b003816307774c187318a3d875f27966: 2023-09-21 08:02:01,126 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695283304970.09d64ef43d820f98201455b18ccbb79b. 2023-09-21 08:02:01,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 09d64ef43d820f98201455b18ccbb79b: 2023-09-21 08:02:01,128 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b003816307774c187318a3d875f27966 2023-09-21 08:02:01,129 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=b003816307774c187318a3d875f27966, regionState=CLOSED 2023-09-21 08:02:01,129 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695283304970.b003816307774c187318a3d875f27966.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695283321129"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695283321129"}]},"ts":"1695283321129"} 2023-09-21 08:02:01,129 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 09d64ef43d820f98201455b18ccbb79b 2023-09-21 08:02:01,130 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=09d64ef43d820f98201455b18ccbb79b, regionState=CLOSED 2023-09-21 08:02:01,130 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695283304970.09d64ef43d820f98201455b18ccbb79b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695283321129"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695283321129"}]},"ts":"1695283321129"} 2023-09-21 08:02:01,133 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=37 2023-09-21 08:02:01,133 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure b003816307774c187318a3d875f27966, server=jenkins-hbase4.apache.org,36469,1695283279785 in 168 msec 2023-09-21 08:02:01,134 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=38 2023-09-21 08:02:01,134 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 09d64ef43d820f98201455b18ccbb79b, server=jenkins-hbase4.apache.org,43299,1695283279840 in 169 msec 2023-09-21 08:02:01,134 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b003816307774c187318a3d875f27966, UNASSIGN in 176 msec 2023-09-21 08:02:01,136 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=38, resume processing ppid=36 2023-09-21 08:02:01,136 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=09d64ef43d820f98201455b18ccbb79b, UNASSIGN in 177 msec 2023-09-21 08:02:01,136 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695283321136"}]},"ts":"1695283321136"} 2023-09-21 08:02:01,138 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-21 08:02:01,140 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-21 08:02:01,142 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 195 msec 2023-09-21 08:02:01,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-21 08:02:01,255 INFO [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-21 08:02:01,256 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-09-21 08:02:01,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-21 08:02:01,260 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-21 08:02:01,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-21 08:02:01,260 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-21 08:02:01,262 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43299] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-21 08:02:01,265 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-21 08:02:01,265 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-21 08:02:01,265 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-21 08:02:01,265 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-21 08:02:01,266 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-21 08:02:01,266 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemState/b003816307774c187318a3d875f27966 2023-09-21 08:02:01,266 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemState/09d64ef43d820f98201455b18ccbb79b 2023-09-21 08:02:01,266 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-21 08:02:01,267 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-21 08:02:01,267 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-21 08:02:01,268 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemState/b003816307774c187318a3d875f27966/cf, FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemState/b003816307774c187318a3d875f27966/recovered.edits] 2023-09-21 08:02:01,268 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemState/09d64ef43d820f98201455b18ccbb79b/cf, FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemState/09d64ef43d820f98201455b18ccbb79b/recovered.edits] 2023-09-21 08:02:01,272 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-21 08:02:01,272 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-21 08:02:01,272 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-21 08:02:01,272 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:02:01,272 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:02:01,272 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:02:01,272 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-21 08:02:01,272 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:02:01,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-21 08:02:01,275 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemState/09d64ef43d820f98201455b18ccbb79b/cf/65599b965d2641dda99a346d8f14a3c6 to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/archive/data/default/testtb-testExportFileSystemState/09d64ef43d820f98201455b18ccbb79b/cf/65599b965d2641dda99a346d8f14a3c6 2023-09-21 08:02:01,275 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemState/b003816307774c187318a3d875f27966/cf/1db6c651b8f5460694e8c874d029682d to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/archive/data/default/testtb-testExportFileSystemState/b003816307774c187318a3d875f27966/cf/1db6c651b8f5460694e8c874d029682d 2023-09-21 08:02:01,278 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemState/09d64ef43d820f98201455b18ccbb79b/recovered.edits/9.seqid to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/archive/data/default/testtb-testExportFileSystemState/09d64ef43d820f98201455b18ccbb79b/recovered.edits/9.seqid 2023-09-21 08:02:01,278 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemState/b003816307774c187318a3d875f27966/recovered.edits/9.seqid to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/archive/data/default/testtb-testExportFileSystemState/b003816307774c187318a3d875f27966/recovered.edits/9.seqid 2023-09-21 08:02:01,279 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemState/09d64ef43d820f98201455b18ccbb79b 2023-09-21 08:02:01,279 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemState/b003816307774c187318a3d875f27966 2023-09-21 08:02:01,279 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-21 08:02:01,280 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-21 08:02:01,280 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-21 08:02:01,284 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230921429baae4dba24b3496577f246ea074df to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230921429baae4dba24b3496577f246ea074df 2023-09-21 08:02:01,285 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309214a20f3d874c84f878d96409b23049fc0 to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309214a20f3d874c84f878d96409b23049fc0 2023-09-21 08:02:01,286 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-21 08:02:01,288 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-21 08:02:01,291 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-21 08:02:01,293 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-21 08:02:01,295 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-21 08:02:01,295 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-21 08:02:01,295 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1695283304970.b003816307774c187318a3d875f27966.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695283321295"}]},"ts":"9223372036854775807"} 2023-09-21 08:02:01,295 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1695283304970.09d64ef43d820f98201455b18ccbb79b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695283321295"}]},"ts":"9223372036854775807"} 2023-09-21 08:02:01,298 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-21 08:02:01,298 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b003816307774c187318a3d875f27966, NAME => 'testtb-testExportFileSystemState,,1695283304970.b003816307774c187318a3d875f27966.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 09d64ef43d820f98201455b18ccbb79b, NAME => 'testtb-testExportFileSystemState,1,1695283304970.09d64ef43d820f98201455b18ccbb79b.', STARTKEY => '1', ENDKEY => ''}] 2023-09-21 08:02:01,298 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-21 08:02:01,298 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695283321298"}]},"ts":"9223372036854775807"} 2023-09-21 08:02:01,301 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-21 08:02:01,304 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-21 08:02:01,306 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 48 msec 2023-09-21 08:02:01,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-21 08:02:01,376 INFO [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-21 08:02:01,384 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-21 08:02:01,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-21 08:02:01,389 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-09-21 08:02:01,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-21 08:02:01,421 INFO [Listener at jenkins-hbase4.apache.org/40119] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=766 (was 755) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x47a0dadd-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-501182444_17 at /127.0.0.1:47500 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-501182444_17 at /127.0.0.1:40770 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1104155582) connection to jenkins-hbase4.apache.org/172.31.14.131:33471 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x47a0dadd-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1104155582) connection to jenkins-hbase4.apache.org/172.31.14.131:40119 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1109511254_1 at /127.0.0.1:52298 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-501182444_17 at /127.0.0.1:52318 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x47a0dadd-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x47a0dadd-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1962 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) - Thread LEAK? -, OpenFileDescriptor=936 (was 920) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=155 (was 178), ProcessCount=168 (was 167) - ProcessCount LEAK? -, AvailableMemoryMB=2534 (was 2587) 2023-09-21 08:02:01,421 WARN [Listener at jenkins-hbase4.apache.org/40119] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-21 08:02:01,444 INFO [Listener at jenkins-hbase4.apache.org/40119] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=766, OpenFileDescriptor=936, MaxFileDescriptor=60000, SystemLoadAverage=155, ProcessCount=168, AvailableMemoryMB=2533 2023-09-21 08:02:01,444 WARN [Listener at jenkins-hbase4.apache.org/40119] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-21 08:02:01,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-21 08:02:01,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-21 08:02:01,450 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-21 08:02:01,451 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-21 08:02:01,451 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-21 08:02:01,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-21 08:02:01,454 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testConsecutiveExports/42119054bb0c03464d9cf6500a3f8fdc 2023-09-21 08:02:01,454 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testConsecutiveExports/dde5ba796672867c0dba4c47c7feebf4 2023-09-21 08:02:01,455 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testConsecutiveExports/42119054bb0c03464d9cf6500a3f8fdc empty. 2023-09-21 08:02:01,455 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testConsecutiveExports/dde5ba796672867c0dba4c47c7feebf4 empty. 2023-09-21 08:02:01,455 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testConsecutiveExports/42119054bb0c03464d9cf6500a3f8fdc 2023-09-21 08:02:01,455 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testConsecutiveExports/dde5ba796672867c0dba4c47c7feebf4 2023-09-21 08:02:01,455 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-21 08:02:01,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-21 08:02:01,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-21 08:02:01,868 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-21 08:02:01,870 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 42119054bb0c03464d9cf6500a3f8fdc, NAME => 'testtb-testConsecutiveExports,,1695283321446.42119054bb0c03464d9cf6500a3f8fdc.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp 2023-09-21 08:02:01,870 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => dde5ba796672867c0dba4c47c7feebf4, NAME => 'testtb-testConsecutiveExports,1,1695283321446.dde5ba796672867c0dba4c47c7feebf4.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp 2023-09-21 08:02:01,884 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695283321446.dde5ba796672867c0dba4c47c7feebf4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 08:02:01,884 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing dde5ba796672867c0dba4c47c7feebf4, disabling compactions & flushes 2023-09-21 08:02:01,884 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695283321446.dde5ba796672867c0dba4c47c7feebf4. 2023-09-21 08:02:01,884 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695283321446.dde5ba796672867c0dba4c47c7feebf4. 2023-09-21 08:02:01,884 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695283321446.dde5ba796672867c0dba4c47c7feebf4. after waiting 0 ms 2023-09-21 08:02:01,884 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695283321446.dde5ba796672867c0dba4c47c7feebf4. 2023-09-21 08:02:01,884 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695283321446.dde5ba796672867c0dba4c47c7feebf4. 2023-09-21 08:02:01,884 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for dde5ba796672867c0dba4c47c7feebf4: 2023-09-21 08:02:02,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-21 08:02:02,284 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695283321446.42119054bb0c03464d9cf6500a3f8fdc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 08:02:02,284 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 42119054bb0c03464d9cf6500a3f8fdc, disabling compactions & flushes 2023-09-21 08:02:02,284 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695283321446.42119054bb0c03464d9cf6500a3f8fdc. 2023-09-21 08:02:02,284 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695283321446.42119054bb0c03464d9cf6500a3f8fdc. 2023-09-21 08:02:02,284 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695283321446.42119054bb0c03464d9cf6500a3f8fdc. after waiting 0 ms 2023-09-21 08:02:02,284 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695283321446.42119054bb0c03464d9cf6500a3f8fdc. 2023-09-21 08:02:02,284 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695283321446.42119054bb0c03464d9cf6500a3f8fdc. 2023-09-21 08:02:02,284 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 42119054bb0c03464d9cf6500a3f8fdc: 2023-09-21 08:02:02,287 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-21 08:02:02,288 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695283321446.dde5ba796672867c0dba4c47c7feebf4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695283322288"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695283322288"}]},"ts":"1695283322288"} 2023-09-21 08:02:02,288 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695283321446.42119054bb0c03464d9cf6500a3f8fdc.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695283322288"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695283322288"}]},"ts":"1695283322288"} 2023-09-21 08:02:02,291 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-21 08:02:02,292 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-21 08:02:02,292 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695283322292"}]},"ts":"1695283322292"} 2023-09-21 08:02:02,294 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-21 08:02:02,297 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-21 08:02:02,298 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-21 08:02:02,298 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-21 08:02:02,298 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-21 08:02:02,298 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-21 08:02:02,299 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=42119054bb0c03464d9cf6500a3f8fdc, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=dde5ba796672867c0dba4c47c7feebf4, ASSIGN}] 2023-09-21 08:02:02,301 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=dde5ba796672867c0dba4c47c7feebf4, ASSIGN 2023-09-21 08:02:02,302 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=42119054bb0c03464d9cf6500a3f8fdc, ASSIGN 2023-09-21 08:02:02,302 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=dde5ba796672867c0dba4c47c7feebf4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36469,1695283279785; forceNewPlan=false, retain=false 2023-09-21 08:02:02,302 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=42119054bb0c03464d9cf6500a3f8fdc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40677,1695283279880; forceNewPlan=false, retain=false 2023-09-21 08:02:02,453 INFO [jenkins-hbase4:34581] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-21 08:02:02,455 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=dde5ba796672867c0dba4c47c7feebf4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:02,455 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=42119054bb0c03464d9cf6500a3f8fdc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:02,456 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695283321446.dde5ba796672867c0dba4c47c7feebf4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695283322455"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695283322455"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695283322455"}]},"ts":"1695283322455"} 2023-09-21 08:02:02,456 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695283321446.42119054bb0c03464d9cf6500a3f8fdc.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695283322455"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695283322455"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695283322455"}]},"ts":"1695283322455"} 2023-09-21 08:02:02,458 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure dde5ba796672867c0dba4c47c7feebf4, server=jenkins-hbase4.apache.org,36469,1695283279785}] 2023-09-21 08:02:02,459 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 42119054bb0c03464d9cf6500a3f8fdc, server=jenkins-hbase4.apache.org,40677,1695283279880}] 2023-09-21 08:02:02,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-21 08:02:02,616 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1695283321446.dde5ba796672867c0dba4c47c7feebf4. 2023-09-21 08:02:02,616 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1695283321446.42119054bb0c03464d9cf6500a3f8fdc. 2023-09-21 08:02:02,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dde5ba796672867c0dba4c47c7feebf4, NAME => 'testtb-testConsecutiveExports,1,1695283321446.dde5ba796672867c0dba4c47c7feebf4.', STARTKEY => '1', ENDKEY => ''} 2023-09-21 08:02:02,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 42119054bb0c03464d9cf6500a3f8fdc, NAME => 'testtb-testConsecutiveExports,,1695283321446.42119054bb0c03464d9cf6500a3f8fdc.', STARTKEY => '', ENDKEY => '1'} 2023-09-21 08:02:02,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1695283321446.dde5ba796672867c0dba4c47c7feebf4. service=AccessControlService 2023-09-21 08:02:02,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1695283321446.42119054bb0c03464d9cf6500a3f8fdc. service=AccessControlService 2023-09-21 08:02:02,617 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 08:02:02,617 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 08:02:02,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports dde5ba796672867c0dba4c47c7feebf4 2023-09-21 08:02:02,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 42119054bb0c03464d9cf6500a3f8fdc 2023-09-21 08:02:02,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695283321446.dde5ba796672867c0dba4c47c7feebf4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 08:02:02,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695283321446.42119054bb0c03464d9cf6500a3f8fdc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 08:02:02,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dde5ba796672867c0dba4c47c7feebf4 2023-09-21 08:02:02,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 42119054bb0c03464d9cf6500a3f8fdc 2023-09-21 08:02:02,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dde5ba796672867c0dba4c47c7feebf4 2023-09-21 08:02:02,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 42119054bb0c03464d9cf6500a3f8fdc 2023-09-21 08:02:02,619 INFO [StoreOpener-42119054bb0c03464d9cf6500a3f8fdc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 42119054bb0c03464d9cf6500a3f8fdc 2023-09-21 08:02:02,619 INFO [StoreOpener-dde5ba796672867c0dba4c47c7feebf4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region dde5ba796672867c0dba4c47c7feebf4 2023-09-21 08:02:02,620 DEBUG [StoreOpener-42119054bb0c03464d9cf6500a3f8fdc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testConsecutiveExports/42119054bb0c03464d9cf6500a3f8fdc/cf 2023-09-21 08:02:02,620 DEBUG [StoreOpener-42119054bb0c03464d9cf6500a3f8fdc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testConsecutiveExports/42119054bb0c03464d9cf6500a3f8fdc/cf 2023-09-21 08:02:02,620 DEBUG [StoreOpener-dde5ba796672867c0dba4c47c7feebf4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testConsecutiveExports/dde5ba796672867c0dba4c47c7feebf4/cf 2023-09-21 08:02:02,621 DEBUG [StoreOpener-dde5ba796672867c0dba4c47c7feebf4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testConsecutiveExports/dde5ba796672867c0dba4c47c7feebf4/cf 2023-09-21 08:02:02,621 INFO [StoreOpener-42119054bb0c03464d9cf6500a3f8fdc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 42119054bb0c03464d9cf6500a3f8fdc columnFamilyName cf 2023-09-21 08:02:02,621 INFO [StoreOpener-dde5ba796672867c0dba4c47c7feebf4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dde5ba796672867c0dba4c47c7feebf4 columnFamilyName cf 2023-09-21 08:02:02,622 INFO [StoreOpener-42119054bb0c03464d9cf6500a3f8fdc-1] regionserver.HStore(310): Store=42119054bb0c03464d9cf6500a3f8fdc/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 08:02:02,622 INFO [StoreOpener-dde5ba796672867c0dba4c47c7feebf4-1] regionserver.HStore(310): Store=dde5ba796672867c0dba4c47c7feebf4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 08:02:02,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testConsecutiveExports/42119054bb0c03464d9cf6500a3f8fdc 2023-09-21 08:02:02,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testConsecutiveExports/dde5ba796672867c0dba4c47c7feebf4 2023-09-21 08:02:02,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testConsecutiveExports/42119054bb0c03464d9cf6500a3f8fdc 2023-09-21 08:02:02,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testConsecutiveExports/dde5ba796672867c0dba4c47c7feebf4 2023-09-21 08:02:02,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 42119054bb0c03464d9cf6500a3f8fdc 2023-09-21 08:02:02,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dde5ba796672867c0dba4c47c7feebf4 2023-09-21 08:02:02,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testConsecutiveExports/42119054bb0c03464d9cf6500a3f8fdc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-21 08:02:02,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testConsecutiveExports/dde5ba796672867c0dba4c47c7feebf4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-21 08:02:02,630 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 42119054bb0c03464d9cf6500a3f8fdc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74106026, jitterRate=0.10426583886146545}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-21 08:02:02,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 42119054bb0c03464d9cf6500a3f8fdc: 2023-09-21 08:02:02,630 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dde5ba796672867c0dba4c47c7feebf4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63649661, jitterRate=-0.051546141505241394}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-21 08:02:02,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dde5ba796672867c0dba4c47c7feebf4: 2023-09-21 08:02:02,631 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1695283321446.42119054bb0c03464d9cf6500a3f8fdc., pid=46, masterSystemTime=1695283322610 2023-09-21 08:02:02,631 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1695283321446.dde5ba796672867c0dba4c47c7feebf4., pid=45, masterSystemTime=1695283322610 2023-09-21 08:02:02,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1695283321446.42119054bb0c03464d9cf6500a3f8fdc. 2023-09-21 08:02:02,635 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1695283321446.42119054bb0c03464d9cf6500a3f8fdc. 2023-09-21 08:02:02,635 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=42119054bb0c03464d9cf6500a3f8fdc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:02,636 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1695283321446.42119054bb0c03464d9cf6500a3f8fdc.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695283322635"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695283322635"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695283322635"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695283322635"}]},"ts":"1695283322635"} 2023-09-21 08:02:02,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1695283321446.dde5ba796672867c0dba4c47c7feebf4. 2023-09-21 08:02:02,636 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1695283321446.dde5ba796672867c0dba4c47c7feebf4. 2023-09-21 08:02:02,637 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=dde5ba796672867c0dba4c47c7feebf4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:02,637 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1695283321446.dde5ba796672867c0dba4c47c7feebf4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695283322636"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695283322636"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695283322636"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695283322636"}]},"ts":"1695283322636"} 2023-09-21 08:02:02,640 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=43 2023-09-21 08:02:02,640 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 42119054bb0c03464d9cf6500a3f8fdc, server=jenkins-hbase4.apache.org,40677,1695283279880 in 180 msec 2023-09-21 08:02:02,641 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-09-21 08:02:02,641 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure dde5ba796672867c0dba4c47c7feebf4, server=jenkins-hbase4.apache.org,36469,1695283279785 in 181 msec 2023-09-21 08:02:02,642 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=42119054bb0c03464d9cf6500a3f8fdc, ASSIGN in 341 msec 2023-09-21 08:02:02,643 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=42 2023-09-21 08:02:02,643 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=dde5ba796672867c0dba4c47c7feebf4, ASSIGN in 342 msec 2023-09-21 08:02:02,643 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-21 08:02:02,644 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695283322644"}]},"ts":"1695283322644"} 2023-09-21 08:02:02,645 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-21 08:02:02,648 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-21 08:02:02,649 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-21 08:02:02,651 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43299] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-21 08:02:02,652 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:02:02,652 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:02:02,652 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:02:02,652 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:02:02,654 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-21 08:02:02,654 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-21 08:02:02,654 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-21 08:02:02,655 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-21 08:02:02,656 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 1.2080 sec 2023-09-21 08:02:03,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-21 08:02:03,559 INFO [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-21 08:02:03,562 DEBUG [Listener at jenkins-hbase4.apache.org/40119] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-21 08:02:03,562 DEBUG [Listener at jenkins-hbase4.apache.org/40119] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695283321446.42119054bb0c03464d9cf6500a3f8fdc. 2023-09-21 08:02:03,565 INFO [Listener at jenkins-hbase4.apache.org/40119] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-21 08:02:03,578 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-21 08:02:03,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695283323578 (current time:1695283323578). 2023-09-21 08:02:03,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-21 08:02:03,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(139): Connect 0x62ccd312 to 127.0.0.1:58708 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 08:02:03,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ba47fbe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 08:02:03,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:02:03,591 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46044, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:02:03,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62ccd312 to 127.0.0.1:58708 2023-09-21 08:02:03,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 08:02:03,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(139): Connect 0x472db679 to 127.0.0.1:58708 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 08:02:03,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ff766b3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 08:02:03,600 DEBUG [hconnection-0x17cfb831-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:02:03,603 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46046, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:02:03,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:02:03,609 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50322, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:02:03,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x472db679 to 127.0.0.1:58708 2023-09-21 08:02:03,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 08:02:03,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-21 08:02:03,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-21 08:02:03,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-21 08:02:03,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-21 08:02:03,615 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-21 08:02:03,616 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695283923616 2023-09-21 08:02:03,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-21 08:02:03,616 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-21 08:02:03,617 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-21 08:02:03,617 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-21 08:02:03,621 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-21 08:02:03,621 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-21 08:02:03,622 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-09-21 08:02:03,623 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-21 08:02:03,624 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695283923624 2023-09-21 08:02:03,638 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,638 INFO [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-21 08:02:03,639 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:02:03,640 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-21 08:02:03,640 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-21 08:02:03,640 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,640 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,641 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:03,641 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:03,641 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:03,641 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:03,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:03,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:03,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:03,642 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:03,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:03,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:03,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:03,642 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:03,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,643 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:03,643 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-21 08:02:03,643 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,643 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,643 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-21 08:02:03,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-21 08:02:03,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-21 08:02:03,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,645 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-21 08:02:03,645 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-21 08:02:03,645 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-21 08:02:03,645 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,645 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,645 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-21 08:02:03,646 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-21 08:02:03,646 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:02:03,646 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:02:03,645 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,648 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-21 08:02:03,648 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-21 08:02:03,648 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-21 08:02:03,648 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:02:03,647 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-21 08:02:03,651 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-21 08:02:03,651 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-21 08:02:03,651 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-21 08:02:03,651 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36469,1695283279785' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-21 08:02:03,651 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40677,1695283279880' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-21 08:02:03,648 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43299,1695283279840' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-21 08:02:03,655 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:03,655 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:03,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:02:03,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:02:03,655 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:03,655 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,656 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:02:03,656 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,656 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,656 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 08:02:03,656 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 08:02:03,656 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:02:03,656 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 08:02:03,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:03,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:03,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:03,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:02:03,658 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40677,1695283279880' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-21 08:02:03,658 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b06d5b1[Count = 1] remaining members to acquire global barrier 2023-09-21 08:02:03,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:03,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:02:03,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:02:03,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:02:03,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:02:03,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:03,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:03,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:03,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:02:03,660 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36469,1695283279785' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-21 08:02:03,660 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b06d5b1[Count = 0] remaining members to acquire global barrier 2023-09-21 08:02:03,660 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-21 08:02:03,660 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,661 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,661 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,661 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,662 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-21 08:02:03,662 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:03,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,662 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-21 08:02:03,662 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695283321446.dde5ba796672867c0dba4c47c7feebf4. 2023-09-21 08:02:03,662 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-21 08:02:03,662 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:03,662 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-21 08:02:03,662 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 08:02:03,662 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 08:02:03,662 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 08:02:03,662 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695283321446.42119054bb0c03464d9cf6500a3f8fdc. 2023-09-21 08:02:03,662 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695283321446.dde5ba796672867c0dba4c47c7feebf4. started... 2023-09-21 08:02:03,662 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695283321446.42119054bb0c03464d9cf6500a3f8fdc. started... 2023-09-21 08:02:03,662 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-21 08:02:03,662 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 08:02:03,662 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43299,1695283279840' in zk 2023-09-21 08:02:03,664 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dde5ba796672867c0dba4c47c7feebf4: 2023-09-21 08:02:03,664 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 42119054bb0c03464d9cf6500a3f8fdc: 2023-09-21 08:02:03,664 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695283321446.dde5ba796672867c0dba4c47c7feebf4.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,664 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695283321446.42119054bb0c03464d9cf6500a3f8fdc.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,664 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 08:02:03,664 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-21 08:02:03,666 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 08:02:03,666 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-21 08:02:03,677 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-21 08:02:03,677 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:02:03,677 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-21 08:02:03,685 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695283321446.42119054bb0c03464d9cf6500a3f8fdc. completed. 2023-09-21 08:02:03,685 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695283321446.dde5ba796672867c0dba4c47c7feebf4. completed. 2023-09-21 08:02:03,685 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695283321446.dde5ba796672867c0dba4c47c7feebf4. 2023-09-21 08:02:03,685 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695283321446.42119054bb0c03464d9cf6500a3f8fdc. 2023-09-21 08:02:03,685 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 08:02:03,685 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 08:02:03,685 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:03,685 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 08:02:03,686 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 08:02:03,686 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:03,685 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-21 08:02:03,686 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-21 08:02:03,686 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,36469,1695283279785' in zk 2023-09-21 08:02:03,686 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40677,1695283279880' in zk 2023-09-21 08:02:03,688 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-21 08:02:03,688 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-21 08:02:03,688 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:02:03,688 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:03,688 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-21 08:02:03,689 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:03,688 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:02:03,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:03,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:02:03,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:02:03,690 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-21 08:02:03,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:02:03,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:02:03,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:03,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:03,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:03,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:02:03,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:03,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:03,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:03,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,40677,1695283279880': 2023-09-21 08:02:03,695 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40677,1695283279880' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-21 08:02:03,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:03,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:02:03,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:02:03,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:02:03,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:02:03,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:03,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:03,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:03,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:02:03,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:03,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:03,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:03,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,36469,1695283279785': 2023-09-21 08:02:03,700 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36469,1695283279785' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-21 08:02:03,700 INFO [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-21 08:02:03,700 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-21 08:02:03,701 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-21 08:02:03,701 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,701 INFO [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-21 08:02:03,702 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,702 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,703 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:02:03,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,703 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,703 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:02:03,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:02:03,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:02:03,703 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,703 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:03,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,703 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:02:03,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:02:03,704 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:03,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:02:03,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:02:03,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:02:03,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:02:03,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:02:03,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:02:03,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,704 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:03,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:02:03,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:03,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:03,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:03,706 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:03,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:02:03,706 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:03,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,707 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:03,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:03,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:03,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:03,711 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:03,711 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:03,712 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:03,711 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:03,711 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:03,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:03,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:03,712 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:02:03,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:03,712 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:03,712 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:02:03,712 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:03,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:02:03,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:02:03,712 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:02:03,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:02:03,712 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:02:03,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:03,712 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:02:03,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:03,712 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-21 08:02:03,712 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,714 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,714 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:03,714 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-21 08:02:03,714 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,715 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:03,715 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:03,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:02:03,715 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:02:03,715 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,715 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-21 08:02:03,718 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 08:02:03,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-21 08:02:03,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-21 08:02:03,719 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-21 08:02:03,723 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,724 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,741 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,742 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-21 08:02:03,742 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,743 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:03,743 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695283323616Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695283323723 (+107 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1695283323723Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1695283323723Writing data manifest for emptySnaptb0-testConsecutiveExports at 1695283323727 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1695283323735 (+8 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695283323742 (+7 ms) 2023-09-21 08:02:03,746 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-21 08:02:03,748 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 129 msec 2023-09-21 08:02:03,827 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-21 08:02:03,919 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 08:02:03,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-21 08:02:03,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-21 08:02:03,924 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40677] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1695283321446.42119054bb0c03464d9cf6500a3f8fdc. with WAL disabled. Data may be lost in the event of a crash. 2023-09-21 08:02:03,925 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36469] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1695283321446.dde5ba796672867c0dba4c47c7feebf4. with WAL disabled. Data may be lost in the event of a crash. 2023-09-21 08:02:03,928 DEBUG [Listener at jenkins-hbase4.apache.org/40119] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-21 08:02:03,928 DEBUG [Listener at jenkins-hbase4.apache.org/40119] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695283321446.42119054bb0c03464d9cf6500a3f8fdc. 2023-09-21 08:02:03,929 INFO [Listener at jenkins-hbase4.apache.org/40119] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-21 08:02:03,940 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-21 08:02:03,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695283323940 (current time:1695283323940). 2023-09-21 08:02:03,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-21 08:02:03,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(139): Connect 0x67da8c5d to 127.0.0.1:58708 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 08:02:03,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72f68ce6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 08:02:03,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:02:03,955 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46052, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:02:03,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x67da8c5d to 127.0.0.1:58708 2023-09-21 08:02:03,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 08:02:03,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(139): Connect 0x393c9b44 to 127.0.0.1:58708 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 08:02:03,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ab7505a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 08:02:03,968 DEBUG [hconnection-0x4ce06c56-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:02:03,972 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46060, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:02:03,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:02:03,978 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50332, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:02:03,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x393c9b44 to 127.0.0.1:58708 2023-09-21 08:02:03,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 08:02:03,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-21 08:02:03,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-21 08:02:03,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-21 08:02:03,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-21 08:02:03,984 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-21 08:02:03,985 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695283923985 2023-09-21 08:02:03,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-21 08:02:03,985 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-21 08:02:03,987 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-21 08:02:03,987 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-21 08:02:03,988 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-21 08:02:03,989 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-21 08:02:03,990 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-09-21 08:02:03,991 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-21 08:02:03,991 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695283923991 2023-09-21 08:02:04,087 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 08:02:04,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-21 08:02:04,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-21 08:02:04,089 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-21 08:02:04,289 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 08:02:04,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-21 08:02:04,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-21 08:02:04,291 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-21 08:02:04,406 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-21 08:02:04,406 INFO [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-21 08:02:04,406 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:02:04,406 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-21 08:02:04,406 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-21 08:02:04,407 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,407 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,408 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:04,408 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:04,408 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:04,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:04,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:04,408 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:04,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:04,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:04,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:04,409 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:04,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:04,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,409 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:04,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,409 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,409 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:04,410 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-21 08:02:04,410 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-21 08:02:04,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,410 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,411 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-21 08:02:04,411 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-21 08:02:04,411 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-21 08:02:04,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-21 08:02:04,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-21 08:02:04,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,411 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:02:04,411 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-21 08:02:04,413 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-21 08:02:04,413 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-21 08:02:04,413 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-21 08:02:04,413 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40677,1695283279880' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-21 08:02:04,413 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-21 08:02:04,413 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-21 08:02:04,413 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:02:04,413 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-21 08:02:04,415 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-21 08:02:04,415 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-21 08:02:04,415 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:02:04,415 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-21 08:02:04,416 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-21 08:02:04,416 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-21 08:02:04,416 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36469,1695283279785' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-21 08:02:04,416 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43299,1695283279840' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-21 08:02:04,417 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:04,417 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:04,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:02:04,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:02:04,419 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,421 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:04,421 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,421 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 08:02:04,421 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,421 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,421 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 08:02:04,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:02:04,422 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,422 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 08:02:04,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:02:04,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-21 08:02:04,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:04,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:04,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:04,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:02:04,423 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40677,1695283279880' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-21 08:02:04,423 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64094558[Count = 1] remaining members to acquire global barrier 2023-09-21 08:02:04,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:04,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:02:04,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:02:04,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:02:04,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:02:04,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-21 08:02:04,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:04,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:04,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:04,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:02:04,425 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36469,1695283279785' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-21 08:02:04,426 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64094558[Count = 0] remaining members to acquire global barrier 2023-09-21 08:02:04,426 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-21 08:02:04,426 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,427 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,427 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,427 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,427 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-21 08:02:04,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,427 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-21 08:02:04,428 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-21 08:02:04,428 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43299,1695283279840' in zk 2023-09-21 08:02:04,427 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:04,428 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 08:02:04,428 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 08:02:04,427 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-21 08:02:04,428 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695283321446.dde5ba796672867c0dba4c47c7feebf4. 2023-09-21 08:02:04,428 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695283321446.dde5ba796672867c0dba4c47c7feebf4. started... 2023-09-21 08:02:04,428 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:04,428 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-21 08:02:04,428 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695283321446.42119054bb0c03464d9cf6500a3f8fdc. 2023-09-21 08:02:04,428 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 08:02:04,428 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 08:02:04,428 INFO [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] regionserver.HRegion(2745): Flushing dde5ba796672867c0dba4c47c7feebf4 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-09-21 08:02:04,428 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695283321446.42119054bb0c03464d9cf6500a3f8fdc. started... 2023-09-21 08:02:04,428 INFO [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 42119054bb0c03464d9cf6500a3f8fdc 1/1 column families, dataSize=333 B heapSize=976 B 2023-09-21 08:02:04,430 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-21 08:02:04,430 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:02:04,430 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-21 08:02:04,462 INFO [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309210af32edcda8f4e54bca498c4984c5255 to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309210af32edcda8f4e54bca498c4984c5255 2023-09-21 08:02:04,467 INFO [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230921fc37b3777e064f099ebd3314a646c609 to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230921fc37b3777e064f099ebd3314a646c609 2023-09-21 08:02:04,473 INFO [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testConsecutiveExports/42119054bb0c03464d9cf6500a3f8fdc/.tmp/cf/779d8d18450d4f359d28c812bd05584d 2023-09-21 08:02:04,480 INFO [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testConsecutiveExports/dde5ba796672867c0dba4c47c7feebf4/.tmp/cf/e1e229115d3a495291a2136dd4d710e5 2023-09-21 08:02:04,480 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testConsecutiveExports/42119054bb0c03464d9cf6500a3f8fdc/.tmp/cf/779d8d18450d4f359d28c812bd05584d as hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testConsecutiveExports/42119054bb0c03464d9cf6500a3f8fdc/cf/779d8d18450d4f359d28c812bd05584d 2023-09-21 08:02:04,485 INFO [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testConsecutiveExports/42119054bb0c03464d9cf6500a3f8fdc/cf/779d8d18450d4f359d28c812bd05584d, entries=5, sequenceid=6, filesize=5.7 K 2023-09-21 08:02:04,487 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testConsecutiveExports/dde5ba796672867c0dba4c47c7feebf4/.tmp/cf/e1e229115d3a495291a2136dd4d710e5 as hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testConsecutiveExports/dde5ba796672867c0dba4c47c7feebf4/cf/e1e229115d3a495291a2136dd4d710e5 2023-09-21 08:02:04,489 INFO [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 42119054bb0c03464d9cf6500a3f8fdc in 61ms, sequenceid=6, compaction requested=false 2023-09-21 08:02:04,491 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 42119054bb0c03464d9cf6500a3f8fdc: 2023-09-21 08:02:04,491 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695283321446.42119054bb0c03464d9cf6500a3f8fdc.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-21 08:02:04,491 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 08:02:04,491 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testConsecutiveExports/42119054bb0c03464d9cf6500a3f8fdc/cf/779d8d18450d4f359d28c812bd05584d] hfiles 2023-09-21 08:02:04,491 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testConsecutiveExports/42119054bb0c03464d9cf6500a3f8fdc/cf/779d8d18450d4f359d28c812bd05584d for snapshot=snaptb0-testConsecutiveExports 2023-09-21 08:02:04,495 INFO [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testConsecutiveExports/dde5ba796672867c0dba4c47c7feebf4/cf/e1e229115d3a495291a2136dd4d710e5, entries=45, sequenceid=6, filesize=12.4 K 2023-09-21 08:02:04,496 INFO [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for dde5ba796672867c0dba4c47c7feebf4 in 68ms, sequenceid=6, compaction requested=false 2023-09-21 08:02:04,496 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dde5ba796672867c0dba4c47c7feebf4: 2023-09-21 08:02:04,496 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695283321446.dde5ba796672867c0dba4c47c7feebf4.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-21 08:02:04,496 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 08:02:04,496 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testConsecutiveExports/dde5ba796672867c0dba4c47c7feebf4/cf/e1e229115d3a495291a2136dd4d710e5] hfiles 2023-09-21 08:02:04,496 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testConsecutiveExports/dde5ba796672867c0dba4c47c7feebf4/cf/e1e229115d3a495291a2136dd4d710e5 for snapshot=snaptb0-testConsecutiveExports 2023-09-21 08:02:04,504 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695283321446.42119054bb0c03464d9cf6500a3f8fdc. completed. 2023-09-21 08:02:04,504 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695283321446.42119054bb0c03464d9cf6500a3f8fdc. 2023-09-21 08:02:04,504 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 08:02:04,504 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 08:02:04,504 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:04,504 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-21 08:02:04,504 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40677,1695283279880' in zk 2023-09-21 08:02:04,506 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:04,506 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-21 08:02:04,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:04,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:02:04,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:02:04,506 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:02:04,506 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-21 08:02:04,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:02:04,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:02:04,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-21 08:02:04,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:04,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:04,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:04,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:02:04,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-21 08:02:04,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:04,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:04,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,40677,1695283279880': 2023-09-21 08:02:04,512 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40677,1695283279880' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-21 08:02:04,514 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695283321446.dde5ba796672867c0dba4c47c7feebf4. completed. 2023-09-21 08:02:04,514 DEBUG [rs(jenkins-hbase4.apache.org,36469,1695283279785)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695283321446.dde5ba796672867c0dba4c47c7feebf4. 2023-09-21 08:02:04,514 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 08:02:04,514 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 08:02:04,514 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:04,514 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-21 08:02:04,514 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,36469,1695283279785' in zk 2023-09-21 08:02:04,517 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-21 08:02:04,517 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:04,517 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:02:04,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:04,517 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-21 08:02:04,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:02:04,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:02:04,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:02:04,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:02:04,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-21 08:02:04,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:04,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:04,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:04,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:02:04,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-21 08:02:04,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:04,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:04,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:04,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,36469,1695283279785': 2023-09-21 08:02:04,523 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36469,1695283279785' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-21 08:02:04,523 INFO [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-21 08:02:04,523 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-21 08:02:04,524 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-21 08:02:04,524 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-21 08:02:04,524 INFO [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-21 08:02:04,526 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,526 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,526 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,526 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:02:04,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:02:04,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,526 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:02:04,526 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:02:04,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:02:04,526 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:04,526 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:02:04,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:02:04,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:02:04,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,527 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:04,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:02:04,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:02:04,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-21 08:02:04,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:02:04,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:02:04,527 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:04,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:02:04,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-21 08:02:04,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:04,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:04,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:04,529 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:04,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:02:04,529 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:04,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-21 08:02:04,530 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:04,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:04,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:04,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:04,536 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:04,537 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:04,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:04,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:04,537 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:02:04,536 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:04,536 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:04,539 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,539 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:02:04,539 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:04,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:04,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:04,537 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-21 08:02:04,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:04,537 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:02:04,537 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:02:04,539 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-21 08:02:04,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:04,539 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:04,539 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-21 08:02:04,539 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,540 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-21 08:02:04,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:02:04,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:02:04,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:02:04,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:02:04,540 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:04,540 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,540 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:04,540 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:04,540 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,540 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:02:04,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:02:04,541 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230921fc37b3777e064f099ebd3314a646c609, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309210af32edcda8f4e54bca498c4984c5255] mob files 2023-09-21 08:02:04,541 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230921fc37b3777e064f099ebd3314a646c609 2023-09-21 08:02:04,541 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309210af32edcda8f4e54bca498c4984c5255 2023-09-21 08:02:04,554 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-21 08:02:04,555 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,577 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-21 08:02:04,578 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,578 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,578 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695283323986Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695283324554 (+568 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1695283324554Loading Region manifests for snaptb0-testConsecutiveExports at 1695283324554Writing data manifest for snaptb0-testConsecutiveExports at 1695283324559 (+5 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1695283324568 (+9 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695283324577 (+9 ms) 2023-09-21 08:02:04,581 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-21 08:02:04,583 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 594 msec 2023-09-21 08:02:04,591 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 08:02:04,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-21 08:02:04,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-21 08:02:04,592 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/local-export-1695283324592 2023-09-21 08:02:04,593 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/local-export-1695283324592, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/local-export-1695283324592, srcFsUri=hdfs://localhost:42401, srcDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52 2023-09-21 08:02:04,616 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42401, inputRoot=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52 2023-09-21 08:02:04,616 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@11a519c4, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/local-export-1695283324592, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/local-export-1695283324592/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,616 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42401, inputRoot=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52, snapshotDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-21 08:02:04,626 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/local-export-1695283324592/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-21 08:02:04,639 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:04,640 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:04,640 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:04,640 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:05,516 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/hadoop-6866929342042700581.jar 2023-09-21 08:02:05,517 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:05,517 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:05,584 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/hadoop-3990464904416460669.jar 2023-09-21 08:02:05,584 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:05,585 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:05,585 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:05,586 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:05,586 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:05,586 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:05,587 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-21 08:02:05,587 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-21 08:02:05,587 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-21 08:02:05,588 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-21 08:02:05,588 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-21 08:02:05,589 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-21 08:02:05,589 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-21 08:02:05,590 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-21 08:02:05,590 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-21 08:02:05,590 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-21 08:02:05,591 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 08:02:05,591 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 08:02:05,592 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-21 08:02:05,592 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 08:02:05,592 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 08:02:05,593 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-21 08:02:05,594 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-21 08:02:05,628 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695283286442_0002_000001 (auth:SIMPLE) 2023-09-21 08:02:05,970 WARN [Listener at jenkins-hbase4.apache.org/40119] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-21 08:02:05,972 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-21 08:02:05,974 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-21 08:02:06,026 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-21 08:02:06,026 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-21 08:02:06,442 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695283286442_0003_000001 (auth:SIMPLE) 2023-09-21 08:02:06,706 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-21 08:02:10,134 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695283286442_0003_000001 (auth:SIMPLE) 2023-09-21 08:02:12,357 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695283286442_0003_000001 (auth:SIMPLE) 2023-09-21 08:02:14,742 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695283286442_0003_000001 (auth:SIMPLE) 2023-09-21 08:02:16,132 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-21 08:02:16,132 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-21 08:02:16,137 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-21 08:02:16,137 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-21 08:02:16,138 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-21 08:02:16,138 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-501182444_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-21 08:02:16,141 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(367): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-21 08:02:16,141 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(367): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-21 08:02:16,141 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@58c5b1ac in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/local-export-1695283324592/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/local-export-1695283324592/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-21 08:02:16,141 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/local-export-1695283324592/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-21 08:02:16,141 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/local-export-1695283324592/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-21 08:02:16,142 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/local-export-1695283324592, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/local-export-1695283324592, srcFsUri=hdfs://localhost:42401, srcDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52 2023-09-21 08:02:16,164 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42401, inputRoot=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52 2023-09-21 08:02:16,164 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@735e2e27, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/local-export-1695283324592, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/local-export-1695283324592/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-21 08:02:16,164 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42401, inputRoot=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52, snapshotDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-21 08:02:16,176 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/local-export-1695283324592/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-21 08:02:16,189 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:16,189 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:16,189 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:16,190 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:17,062 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/hadoop-6555885311399827314.jar 2023-09-21 08:02:17,062 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:17,062 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:17,129 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/hadoop-188824899435954823.jar 2023-09-21 08:02:17,129 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:17,130 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:17,130 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:17,130 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:17,131 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:17,131 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:17,131 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-21 08:02:17,132 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-21 08:02:17,132 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-21 08:02:17,133 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-21 08:02:17,133 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-21 08:02:17,133 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-21 08:02:17,134 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-21 08:02:17,134 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-21 08:02:17,134 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-21 08:02:17,135 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-21 08:02:17,136 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 08:02:17,136 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 08:02:17,137 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-21 08:02:17,137 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 08:02:17,137 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 08:02:17,138 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-21 08:02:17,138 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-21 08:02:17,525 WARN [Listener at jenkins-hbase4.apache.org/40119] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-21 08:02:17,528 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-21 08:02:17,530 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-21 08:02:20,911 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-21 08:02:20,911 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-21 08:02:20,914 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695283286442_0003_000001 (auth:SIMPLE) 2023-09-21 08:02:21,637 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695283286442_0004_000001 (auth:SIMPLE) 2023-09-21 08:02:25,270 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695283286442_0004_000001 (auth:SIMPLE) 2023-09-21 08:02:27,486 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695283286442_0004_000001 (auth:SIMPLE) 2023-09-21 08:02:29,719 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695283286442_0004_000001 (auth:SIMPLE) 2023-09-21 08:02:31,700 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-21 08:02:31,700 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-21 08:02:31,704 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-21 08:02:31,704 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-21 08:02:31,704 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-21 08:02:31,704 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-501182444_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-21 08:02:31,708 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(367): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-21 08:02:31,708 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(367): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-21 08:02:31,708 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@58c5b1ac in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/local-export-1695283324592/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/local-export-1695283324592/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-21 08:02:31,708 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/local-export-1695283324592/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-21 08:02:31,708 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/local-export-1695283324592/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-21 08:02:31,721 INFO [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-21 08:02:31,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-09-21 08:02:31,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-21 08:02:31,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-21 08:02:31,725 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695283351725"}]},"ts":"1695283351725"} 2023-09-21 08:02:31,727 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-21 08:02:31,728 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-21 08:02:31,729 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=42119054bb0c03464d9cf6500a3f8fdc, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=dde5ba796672867c0dba4c47c7feebf4, UNASSIGN}] 2023-09-21 08:02:31,731 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=42119054bb0c03464d9cf6500a3f8fdc, UNASSIGN 2023-09-21 08:02:31,731 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=dde5ba796672867c0dba4c47c7feebf4, UNASSIGN 2023-09-21 08:02:31,731 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=42119054bb0c03464d9cf6500a3f8fdc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:31,732 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=dde5ba796672867c0dba4c47c7feebf4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:31,732 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695283321446.42119054bb0c03464d9cf6500a3f8fdc.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695283351731"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695283351731"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695283351731"}]},"ts":"1695283351731"} 2023-09-21 08:02:31,732 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695283321446.dde5ba796672867c0dba4c47c7feebf4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695283351732"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695283351732"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695283351732"}]},"ts":"1695283351732"} 2023-09-21 08:02:31,733 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 42119054bb0c03464d9cf6500a3f8fdc, server=jenkins-hbase4.apache.org,40677,1695283279880}] 2023-09-21 08:02:31,734 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure dde5ba796672867c0dba4c47c7feebf4, server=jenkins-hbase4.apache.org,36469,1695283279785}] 2023-09-21 08:02:31,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-21 08:02:31,885 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 42119054bb0c03464d9cf6500a3f8fdc 2023-09-21 08:02:31,885 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 42119054bb0c03464d9cf6500a3f8fdc, disabling compactions & flushes 2023-09-21 08:02:31,885 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695283321446.42119054bb0c03464d9cf6500a3f8fdc. 2023-09-21 08:02:31,885 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695283321446.42119054bb0c03464d9cf6500a3f8fdc. 2023-09-21 08:02:31,885 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695283321446.42119054bb0c03464d9cf6500a3f8fdc. after waiting 0 ms 2023-09-21 08:02:31,885 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695283321446.42119054bb0c03464d9cf6500a3f8fdc. 2023-09-21 08:02:31,886 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close dde5ba796672867c0dba4c47c7feebf4 2023-09-21 08:02:31,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dde5ba796672867c0dba4c47c7feebf4, disabling compactions & flushes 2023-09-21 08:02:31,889 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695283321446.dde5ba796672867c0dba4c47c7feebf4. 2023-09-21 08:02:31,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695283321446.dde5ba796672867c0dba4c47c7feebf4. 2023-09-21 08:02:31,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695283321446.dde5ba796672867c0dba4c47c7feebf4. after waiting 0 ms 2023-09-21 08:02:31,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695283321446.dde5ba796672867c0dba4c47c7feebf4. 2023-09-21 08:02:31,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testConsecutiveExports/42119054bb0c03464d9cf6500a3f8fdc/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-21 08:02:31,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testConsecutiveExports/dde5ba796672867c0dba4c47c7feebf4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-21 08:02:31,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 08:02:31,906 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695283321446.42119054bb0c03464d9cf6500a3f8fdc. 2023-09-21 08:02:31,906 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 42119054bb0c03464d9cf6500a3f8fdc: 2023-09-21 08:02:31,906 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 08:02:31,907 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695283321446.dde5ba796672867c0dba4c47c7feebf4. 2023-09-21 08:02:31,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dde5ba796672867c0dba4c47c7feebf4: 2023-09-21 08:02:31,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 42119054bb0c03464d9cf6500a3f8fdc 2023-09-21 08:02:31,908 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=42119054bb0c03464d9cf6500a3f8fdc, regionState=CLOSED 2023-09-21 08:02:31,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed dde5ba796672867c0dba4c47c7feebf4 2023-09-21 08:02:31,908 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695283321446.42119054bb0c03464d9cf6500a3f8fdc.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695283351908"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695283351908"}]},"ts":"1695283351908"} 2023-09-21 08:02:31,909 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=dde5ba796672867c0dba4c47c7feebf4, regionState=CLOSED 2023-09-21 08:02:31,909 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695283321446.dde5ba796672867c0dba4c47c7feebf4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695283351909"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695283351909"}]},"ts":"1695283351909"} 2023-09-21 08:02:31,911 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=52 2023-09-21 08:02:31,912 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 42119054bb0c03464d9cf6500a3f8fdc, server=jenkins-hbase4.apache.org,40677,1695283279880 in 177 msec 2023-09-21 08:02:31,912 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=53 2023-09-21 08:02:31,912 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure dde5ba796672867c0dba4c47c7feebf4, server=jenkins-hbase4.apache.org,36469,1695283279785 in 177 msec 2023-09-21 08:02:31,913 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=42119054bb0c03464d9cf6500a3f8fdc, UNASSIGN in 182 msec 2023-09-21 08:02:31,914 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-09-21 08:02:31,914 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=dde5ba796672867c0dba4c47c7feebf4, UNASSIGN in 183 msec 2023-09-21 08:02:31,914 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695283351914"}]},"ts":"1695283351914"} 2023-09-21 08:02:31,915 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-21 08:02:31,917 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-21 08:02:31,918 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 196 msec 2023-09-21 08:02:32,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-21 08:02:32,027 INFO [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-21 08:02:32,028 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-09-21 08:02:32,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-21 08:02:32,031 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-21 08:02:32,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-21 08:02:32,032 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-21 08:02:32,035 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43299] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-21 08:02:32,038 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testConsecutiveExports/42119054bb0c03464d9cf6500a3f8fdc 2023-09-21 08:02:32,038 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testConsecutiveExports/dde5ba796672867c0dba4c47c7feebf4 2023-09-21 08:02:32,039 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-21 08:02:32,039 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-21 08:02:32,039 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-21 08:02:32,039 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-21 08:02:32,039 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-21 08:02:32,039 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-21 08:02:32,039 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-21 08:02:32,039 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-21 08:02:32,040 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testConsecutiveExports/42119054bb0c03464d9cf6500a3f8fdc/cf, FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testConsecutiveExports/42119054bb0c03464d9cf6500a3f8fdc/recovered.edits] 2023-09-21 08:02:32,040 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testConsecutiveExports/dde5ba796672867c0dba4c47c7feebf4/cf, FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testConsecutiveExports/dde5ba796672867c0dba4c47c7feebf4/recovered.edits] 2023-09-21 08:02:32,040 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-21 08:02:32,041 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:02:32,041 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-21 08:02:32,041 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-21 08:02:32,041 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:02:32,041 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-21 08:02:32,041 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:02:32,041 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:02:32,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-21 08:02:32,049 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testConsecutiveExports/dde5ba796672867c0dba4c47c7feebf4/cf/e1e229115d3a495291a2136dd4d710e5 to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/archive/data/default/testtb-testConsecutiveExports/dde5ba796672867c0dba4c47c7feebf4/cf/e1e229115d3a495291a2136dd4d710e5 2023-09-21 08:02:32,049 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testConsecutiveExports/42119054bb0c03464d9cf6500a3f8fdc/cf/779d8d18450d4f359d28c812bd05584d to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/archive/data/default/testtb-testConsecutiveExports/42119054bb0c03464d9cf6500a3f8fdc/cf/779d8d18450d4f359d28c812bd05584d 2023-09-21 08:02:32,052 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testConsecutiveExports/dde5ba796672867c0dba4c47c7feebf4/recovered.edits/9.seqid to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/archive/data/default/testtb-testConsecutiveExports/dde5ba796672867c0dba4c47c7feebf4/recovered.edits/9.seqid 2023-09-21 08:02:32,052 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testConsecutiveExports/42119054bb0c03464d9cf6500a3f8fdc/recovered.edits/9.seqid to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/archive/data/default/testtb-testConsecutiveExports/42119054bb0c03464d9cf6500a3f8fdc/recovered.edits/9.seqid 2023-09-21 08:02:32,053 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testConsecutiveExports/dde5ba796672867c0dba4c47c7feebf4 2023-09-21 08:02:32,053 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testConsecutiveExports/42119054bb0c03464d9cf6500a3f8fdc 2023-09-21 08:02:32,053 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-21 08:02:32,054 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-21 08:02:32,054 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-21 08:02:32,057 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230921fc37b3777e064f099ebd3314a646c609 to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230921fc37b3777e064f099ebd3314a646c609 2023-09-21 08:02:32,059 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309210af32edcda8f4e54bca498c4984c5255 to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202309210af32edcda8f4e54bca498c4984c5255 2023-09-21 08:02:32,059 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-21 08:02:32,061 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-21 08:02:32,064 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-21 08:02:32,066 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-21 08:02:32,067 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-21 08:02:32,067 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-21 08:02:32,068 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1695283321446.42119054bb0c03464d9cf6500a3f8fdc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695283352068"}]},"ts":"9223372036854775807"} 2023-09-21 08:02:32,068 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1695283321446.dde5ba796672867c0dba4c47c7feebf4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695283352068"}]},"ts":"9223372036854775807"} 2023-09-21 08:02:32,069 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-21 08:02:32,069 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 42119054bb0c03464d9cf6500a3f8fdc, NAME => 'testtb-testConsecutiveExports,,1695283321446.42119054bb0c03464d9cf6500a3f8fdc.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => dde5ba796672867c0dba4c47c7feebf4, NAME => 'testtb-testConsecutiveExports,1,1695283321446.dde5ba796672867c0dba4c47c7feebf4.', STARTKEY => '1', ENDKEY => ''}] 2023-09-21 08:02:32,069 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-21 08:02:32,070 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695283352070"}]},"ts":"9223372036854775807"} 2023-09-21 08:02:32,071 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-21 08:02:32,073 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-21 08:02:32,074 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 45 msec 2023-09-21 08:02:32,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-21 08:02:32,147 INFO [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-21 08:02:32,153 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-21 08:02:32,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-21 08:02:32,156 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-09-21 08:02:32,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-21 08:02:32,181 INFO [Listener at jenkins-hbase4.apache.org/40119] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=747 (was 766), OpenFileDescriptor=905 (was 936), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=121 (was 155), ProcessCount=168 (was 168), AvailableMemoryMB=2383 (was 2533) 2023-09-21 08:02:32,181 WARN [Listener at jenkins-hbase4.apache.org/40119] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-09-21 08:02:32,200 INFO [Listener at jenkins-hbase4.apache.org/40119] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=747, OpenFileDescriptor=905, MaxFileDescriptor=60000, SystemLoadAverage=121, ProcessCount=168, AvailableMemoryMB=2382 2023-09-21 08:02:32,200 WARN [Listener at jenkins-hbase4.apache.org/40119] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-09-21 08:02:32,202 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-21 08:02:32,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,205 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-21 08:02:32,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-21 08:02:32,206 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-21 08:02:32,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-21 08:02:32,209 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2ae81a6c20365c6f7479d10ef3553215 2023-09-21 08:02:32,209 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/edf7ebbff8d0ead21dca48b0cf162774 2023-09-21 08:02:32,210 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2ae81a6c20365c6f7479d10ef3553215 empty. 2023-09-21 08:02:32,210 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/edf7ebbff8d0ead21dca48b0cf162774 empty. 2023-09-21 08:02:32,210 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2ae81a6c20365c6f7479d10ef3553215 2023-09-21 08:02:32,210 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/edf7ebbff8d0ead21dca48b0cf162774 2023-09-21 08:02:32,210 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-21 08:02:32,220 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-21 08:02:32,221 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2ae81a6c20365c6f7479d10ef3553215, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695283352202.2ae81a6c20365c6f7479d10ef3553215.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp 2023-09-21 08:02:32,221 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => edf7ebbff8d0ead21dca48b0cf162774, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695283352202.edf7ebbff8d0ead21dca48b0cf162774.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp 2023-09-21 08:02:32,228 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695283352202.2ae81a6c20365c6f7479d10ef3553215.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 08:02:32,229 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 2ae81a6c20365c6f7479d10ef3553215, disabling compactions & flushes 2023-09-21 08:02:32,229 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695283352202.2ae81a6c20365c6f7479d10ef3553215. 2023-09-21 08:02:32,229 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695283352202.2ae81a6c20365c6f7479d10ef3553215. 2023-09-21 08:02:32,229 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695283352202.2ae81a6c20365c6f7479d10ef3553215. after waiting 0 ms 2023-09-21 08:02:32,229 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695283352202.2ae81a6c20365c6f7479d10ef3553215. 2023-09-21 08:02:32,229 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695283352202.edf7ebbff8d0ead21dca48b0cf162774.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 08:02:32,229 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695283352202.2ae81a6c20365c6f7479d10ef3553215. 2023-09-21 08:02:32,229 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing edf7ebbff8d0ead21dca48b0cf162774, disabling compactions & flushes 2023-09-21 08:02:32,229 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 2ae81a6c20365c6f7479d10ef3553215: 2023-09-21 08:02:32,229 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695283352202.edf7ebbff8d0ead21dca48b0cf162774. 2023-09-21 08:02:32,229 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695283352202.edf7ebbff8d0ead21dca48b0cf162774. 2023-09-21 08:02:32,229 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695283352202.edf7ebbff8d0ead21dca48b0cf162774. after waiting 0 ms 2023-09-21 08:02:32,229 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695283352202.edf7ebbff8d0ead21dca48b0cf162774. 2023-09-21 08:02:32,229 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695283352202.edf7ebbff8d0ead21dca48b0cf162774. 2023-09-21 08:02:32,229 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for edf7ebbff8d0ead21dca48b0cf162774: 2023-09-21 08:02:32,231 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-21 08:02:32,232 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695283352202.2ae81a6c20365c6f7479d10ef3553215.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695283352232"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695283352232"}]},"ts":"1695283352232"} 2023-09-21 08:02:32,232 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695283352202.edf7ebbff8d0ead21dca48b0cf162774.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695283352232"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695283352232"}]},"ts":"1695283352232"} 2023-09-21 08:02:32,238 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-21 08:02:32,239 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-21 08:02:32,240 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695283352240"}]},"ts":"1695283352240"} 2023-09-21 08:02:32,241 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-21 08:02:32,245 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-21 08:02:32,247 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-21 08:02:32,247 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-21 08:02:32,247 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-21 08:02:32,247 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-21 08:02:32,247 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2ae81a6c20365c6f7479d10ef3553215, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=edf7ebbff8d0ead21dca48b0cf162774, ASSIGN}] 2023-09-21 08:02:32,249 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=edf7ebbff8d0ead21dca48b0cf162774, ASSIGN 2023-09-21 08:02:32,250 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2ae81a6c20365c6f7479d10ef3553215, ASSIGN 2023-09-21 08:02:32,250 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2ae81a6c20365c6f7479d10ef3553215, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40677,1695283279880; forceNewPlan=false, retain=false 2023-09-21 08:02:32,250 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=edf7ebbff8d0ead21dca48b0cf162774, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43299,1695283279840; forceNewPlan=false, retain=false 2023-09-21 08:02:32,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-21 08:02:32,400 INFO [jenkins-hbase4:34581] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-21 08:02:32,404 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=edf7ebbff8d0ead21dca48b0cf162774, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:32,404 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=2ae81a6c20365c6f7479d10ef3553215, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:32,404 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695283352202.edf7ebbff8d0ead21dca48b0cf162774.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695283352404"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695283352404"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695283352404"}]},"ts":"1695283352404"} 2023-09-21 08:02:32,404 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695283352202.2ae81a6c20365c6f7479d10ef3553215.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695283352404"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695283352404"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695283352404"}]},"ts":"1695283352404"} 2023-09-21 08:02:32,406 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure edf7ebbff8d0ead21dca48b0cf162774, server=jenkins-hbase4.apache.org,43299,1695283279840}] 2023-09-21 08:02:32,406 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 2ae81a6c20365c6f7479d10ef3553215, server=jenkins-hbase4.apache.org,40677,1695283279880}] 2023-09-21 08:02:32,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-21 08:02:32,564 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1695283352202.2ae81a6c20365c6f7479d10ef3553215. 2023-09-21 08:02:32,564 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1695283352202.edf7ebbff8d0ead21dca48b0cf162774. 2023-09-21 08:02:32,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2ae81a6c20365c6f7479d10ef3553215, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695283352202.2ae81a6c20365c6f7479d10ef3553215.', STARTKEY => '', ENDKEY => '1'} 2023-09-21 08:02:32,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => edf7ebbff8d0ead21dca48b0cf162774, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695283352202.edf7ebbff8d0ead21dca48b0cf162774.', STARTKEY => '1', ENDKEY => ''} 2023-09-21 08:02:32,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1695283352202.2ae81a6c20365c6f7479d10ef3553215. service=AccessControlService 2023-09-21 08:02:32,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1695283352202.edf7ebbff8d0ead21dca48b0cf162774. service=AccessControlService 2023-09-21 08:02:32,565 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 08:02:32,565 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 08:02:32,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 2ae81a6c20365c6f7479d10ef3553215 2023-09-21 08:02:32,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion edf7ebbff8d0ead21dca48b0cf162774 2023-09-21 08:02:32,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695283352202.2ae81a6c20365c6f7479d10ef3553215.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 08:02:32,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695283352202.edf7ebbff8d0ead21dca48b0cf162774.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 08:02:32,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2ae81a6c20365c6f7479d10ef3553215 2023-09-21 08:02:32,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for edf7ebbff8d0ead21dca48b0cf162774 2023-09-21 08:02:32,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2ae81a6c20365c6f7479d10ef3553215 2023-09-21 08:02:32,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for edf7ebbff8d0ead21dca48b0cf162774 2023-09-21 08:02:32,567 INFO [StoreOpener-edf7ebbff8d0ead21dca48b0cf162774-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region edf7ebbff8d0ead21dca48b0cf162774 2023-09-21 08:02:32,567 INFO [StoreOpener-2ae81a6c20365c6f7479d10ef3553215-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2ae81a6c20365c6f7479d10ef3553215 2023-09-21 08:02:32,569 DEBUG [StoreOpener-edf7ebbff8d0ead21dca48b0cf162774-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion/edf7ebbff8d0ead21dca48b0cf162774/cf 2023-09-21 08:02:32,569 DEBUG [StoreOpener-2ae81a6c20365c6f7479d10ef3553215-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion/2ae81a6c20365c6f7479d10ef3553215/cf 2023-09-21 08:02:32,569 DEBUG [StoreOpener-2ae81a6c20365c6f7479d10ef3553215-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion/2ae81a6c20365c6f7479d10ef3553215/cf 2023-09-21 08:02:32,569 DEBUG [StoreOpener-edf7ebbff8d0ead21dca48b0cf162774-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion/edf7ebbff8d0ead21dca48b0cf162774/cf 2023-09-21 08:02:32,570 INFO [StoreOpener-2ae81a6c20365c6f7479d10ef3553215-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2ae81a6c20365c6f7479d10ef3553215 columnFamilyName cf 2023-09-21 08:02:32,570 INFO [StoreOpener-edf7ebbff8d0ead21dca48b0cf162774-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region edf7ebbff8d0ead21dca48b0cf162774 columnFamilyName cf 2023-09-21 08:02:32,571 INFO [StoreOpener-2ae81a6c20365c6f7479d10ef3553215-1] regionserver.HStore(310): Store=2ae81a6c20365c6f7479d10ef3553215/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 08:02:32,571 INFO [StoreOpener-edf7ebbff8d0ead21dca48b0cf162774-1] regionserver.HStore(310): Store=edf7ebbff8d0ead21dca48b0cf162774/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 08:02:32,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion/2ae81a6c20365c6f7479d10ef3553215 2023-09-21 08:02:32,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion/edf7ebbff8d0ead21dca48b0cf162774 2023-09-21 08:02:32,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion/2ae81a6c20365c6f7479d10ef3553215 2023-09-21 08:02:32,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion/edf7ebbff8d0ead21dca48b0cf162774 2023-09-21 08:02:32,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for edf7ebbff8d0ead21dca48b0cf162774 2023-09-21 08:02:32,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2ae81a6c20365c6f7479d10ef3553215 2023-09-21 08:02:32,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion/edf7ebbff8d0ead21dca48b0cf162774/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-21 08:02:32,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion/2ae81a6c20365c6f7479d10ef3553215/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-21 08:02:32,578 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened edf7ebbff8d0ead21dca48b0cf162774; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71831854, jitterRate=0.07037803530693054}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-21 08:02:32,578 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2ae81a6c20365c6f7479d10ef3553215; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64399583, jitterRate=-0.04037143290042877}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-21 08:02:32,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for edf7ebbff8d0ead21dca48b0cf162774: 2023-09-21 08:02:32,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2ae81a6c20365c6f7479d10ef3553215: 2023-09-21 08:02:32,579 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1695283352202.2ae81a6c20365c6f7479d10ef3553215., pid=61, masterSystemTime=1695283352559 2023-09-21 08:02:32,579 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1695283352202.edf7ebbff8d0ead21dca48b0cf162774., pid=60, masterSystemTime=1695283352558 2023-09-21 08:02:32,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1695283352202.2ae81a6c20365c6f7479d10ef3553215. 2023-09-21 08:02:32,581 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1695283352202.2ae81a6c20365c6f7479d10ef3553215. 2023-09-21 08:02:32,582 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=2ae81a6c20365c6f7479d10ef3553215, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:32,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1695283352202.edf7ebbff8d0ead21dca48b0cf162774. 2023-09-21 08:02:32,582 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1695283352202.edf7ebbff8d0ead21dca48b0cf162774. 2023-09-21 08:02:32,582 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695283352202.2ae81a6c20365c6f7479d10ef3553215.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695283352581"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695283352581"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695283352581"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695283352581"}]},"ts":"1695283352581"} 2023-09-21 08:02:32,582 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=edf7ebbff8d0ead21dca48b0cf162774, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:32,583 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695283352202.edf7ebbff8d0ead21dca48b0cf162774.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695283352582"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695283352582"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695283352582"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695283352582"}]},"ts":"1695283352582"} 2023-09-21 08:02:32,585 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=58 2023-09-21 08:02:32,585 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 2ae81a6c20365c6f7479d10ef3553215, server=jenkins-hbase4.apache.org,40677,1695283279880 in 177 msec 2023-09-21 08:02:32,586 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-09-21 08:02:32,586 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure edf7ebbff8d0ead21dca48b0cf162774, server=jenkins-hbase4.apache.org,43299,1695283279840 in 178 msec 2023-09-21 08:02:32,587 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2ae81a6c20365c6f7479d10ef3553215, ASSIGN in 338 msec 2023-09-21 08:02:32,589 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=59, resume processing ppid=57 2023-09-21 08:02:32,589 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=edf7ebbff8d0ead21dca48b0cf162774, ASSIGN in 340 msec 2023-09-21 08:02:32,589 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-21 08:02:32,590 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695283352590"}]},"ts":"1695283352590"} 2023-09-21 08:02:32,591 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-21 08:02:32,594 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-21 08:02:32,594 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-21 08:02:32,596 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43299] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-21 08:02:32,597 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:02:32,597 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:02:32,597 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:02:32,597 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:02:32,599 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-21 08:02:32,599 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-21 08:02:32,599 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-21 08:02:32,599 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-21 08:02:32,600 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 397 msec 2023-09-21 08:02:32,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-21 08:02:32,810 INFO [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-21 08:02:32,812 DEBUG [Listener at jenkins-hbase4.apache.org/40119] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,813 DEBUG [Listener at jenkins-hbase4.apache.org/40119] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695283352202.2ae81a6c20365c6f7479d10ef3553215. 2023-09-21 08:02:32,814 INFO [Listener at jenkins-hbase4.apache.org/40119] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-21 08:02:32,826 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-21 08:02:32,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695283352826 (current time:1695283352826). 2023-09-21 08:02:32,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-21 08:02:32,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(139): Connect 0x74306e5b to 127.0.0.1:58708 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 08:02:32,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4afaa6b4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 08:02:32,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:02:32,838 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56390, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:02:32,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x74306e5b to 127.0.0.1:58708 2023-09-21 08:02:32,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 08:02:32,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(139): Connect 0x5c137fb6 to 127.0.0.1:58708 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 08:02:32,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b2690d9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 08:02:32,846 DEBUG [hconnection-0x34f64c0f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:02:32,847 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56402, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:02:32,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:02:32,853 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37880, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:02:32,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c137fb6 to 127.0.0.1:58708 2023-09-21 08:02:32,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 08:02:32,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-21 08:02:32,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-21 08:02:32,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-21 08:02:32,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-21 08:02:32,858 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-21 08:02:32,858 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695283952858 2023-09-21 08:02:32,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-21 08:02:32,858 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,859 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-21 08:02:32,860 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-21 08:02:32,860 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-21 08:02:32,861 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-21 08:02:32,861 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 4 msec 2023-09-21 08:02:32,862 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-21 08:02:32,863 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695283952863 2023-09-21 08:02:32,874 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,875 INFO [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-21 08:02:32,875 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:02:32,876 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-21 08:02:32,876 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-21 08:02:32,876 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,876 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,878 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:32,879 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:32,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:32,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:32,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:32,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:32,879 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:32,879 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:32,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:32,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:32,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,879 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:32,879 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:32,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,879 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,879 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:32,880 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-21 08:02:32,879 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,880 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-21 08:02:32,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-21 08:02:32,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,880 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-21 08:02:32,880 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-21 08:02:32,880 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-21 08:02:32,880 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-21 08:02:32,880 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,880 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:02:32,881 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-21 08:02:32,882 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-21 08:02:32,882 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-21 08:02:32,882 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43299,1695283279840' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-21 08:02:32,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,882 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:02:32,882 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-21 08:02:32,883 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-21 08:02:32,883 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-21 08:02:32,883 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36469,1695283279785' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-21 08:02:32,883 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,883 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-21 08:02:32,883 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:02:32,884 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-21 08:02:32,884 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-21 08:02:32,884 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40677,1695283279880' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-21 08:02:32,884 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,884 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:32,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:32,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:02:32,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:02:32,886 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:32,886 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,886 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,886 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,886 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 08:02:32,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:02:32,886 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,886 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 08:02:32,886 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,886 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 08:02:32,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:02:32,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:32,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:32,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:32,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:02:32,888 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43299,1695283279840' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-21 08:02:32,888 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ec4259a[Count = 1] remaining members to acquire global barrier 2023-09-21 08:02:32,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:32,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:02:32,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:02:32,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:02:32,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:02:32,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:32,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:32,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:32,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:02:32,890 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40677,1695283279880' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-21 08:02:32,890 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ec4259a[Count = 0] remaining members to acquire global barrier 2023-09-21 08:02:32,890 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-21 08:02:32,890 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,891 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,891 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,891 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,891 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-21 08:02:32,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,891 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-21 08:02:32,891 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:32,891 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-21 08:02:32,891 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,36469,1695283279785' in zk 2023-09-21 08:02:32,891 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 08:02:32,892 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 08:02:32,892 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695283352202.edf7ebbff8d0ead21dca48b0cf162774. 2023-09-21 08:02:32,891 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-21 08:02:32,892 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695283352202.edf7ebbff8d0ead21dca48b0cf162774. started... 2023-09-21 08:02:32,892 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:32,892 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-21 08:02:32,892 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 08:02:32,893 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 08:02:32,893 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695283352202.2ae81a6c20365c6f7479d10ef3553215. 2023-09-21 08:02:32,893 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for edf7ebbff8d0ead21dca48b0cf162774: 2023-09-21 08:02:32,893 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695283352202.2ae81a6c20365c6f7479d10ef3553215. started... 2023-09-21 08:02:32,893 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695283352202.edf7ebbff8d0ead21dca48b0cf162774.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,893 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2ae81a6c20365c6f7479d10ef3553215: 2023-09-21 08:02:32,893 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 08:02:32,893 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-21 08:02:32,893 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695283352202.2ae81a6c20365c6f7479d10ef3553215.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,893 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 08:02:32,893 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-21 08:02:32,903 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695283352202.edf7ebbff8d0ead21dca48b0cf162774. completed. 2023-09-21 08:02:32,903 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695283352202.edf7ebbff8d0ead21dca48b0cf162774. 2023-09-21 08:02:32,903 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 08:02:32,903 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 08:02:32,903 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:32,903 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-21 08:02:32,903 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43299,1695283279840' in zk 2023-09-21 08:02:32,903 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695283352202.2ae81a6c20365c6f7479d10ef3553215. completed. 2023-09-21 08:02:32,903 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695283352202.2ae81a6c20365c6f7479d10ef3553215. 2023-09-21 08:02:32,904 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 08:02:32,904 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 08:02:32,904 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:32,904 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-21 08:02:32,904 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40677,1695283279880' in zk 2023-09-21 08:02:32,905 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-21 08:02:32,905 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:02:32,905 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-21 08:02:32,907 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-21 08:02:32,907 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-21 08:02:32,907 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:32,907 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:02:32,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:32,907 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:02:32,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:02:32,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:02:32,907 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-21 08:02:32,907 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:32,908 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-21 08:02:32,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:02:32,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:02:32,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:32,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:32,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:32,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:02:32,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:32,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:32,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:32,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43299,1695283279840': 2023-09-21 08:02:32,913 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43299,1695283279840' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-21 08:02:32,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:32,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:02:32,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:02:32,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:02:32,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:02:32,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:32,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:32,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:32,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:02:32,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:32,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:32,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:32,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40677,1695283279880': 2023-09-21 08:02:32,916 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40677,1695283279880' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-21 08:02:32,916 INFO [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-21 08:02:32,916 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-21 08:02:32,916 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-21 08:02:32,916 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,916 INFO [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-21 08:02:32,918 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,918 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,918 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:02:32,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,918 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:02:32,918 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,918 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:02:32,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:02:32,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:02:32,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,918 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:02:32,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,918 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:32,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:02:32,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:02:32,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:02:32,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:02:32,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:02:32,919 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:32,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:02:32,923 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:32,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:02:32,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:32,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:32,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:32,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:02:32,925 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:32,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,925 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:32,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:32,925 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:32,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:32,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:32,928 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:32,928 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:32,928 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:32,929 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:32,929 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,929 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:02:32,929 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:32,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:32,929 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:02:32,929 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:02:32,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:32,929 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,929 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:32,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:32,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:32,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:32,929 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:02:32,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:32,930 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,930 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,931 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:32,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:02:32,931 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:02:32,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:02:32,931 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:02:32,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:02:32,931 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:32,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:02:32,931 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:32,931 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-21 08:02:32,931 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,931 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,932 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-21 08:02:32,939 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,940 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,958 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,958 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-21 08:02:32,959 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,959 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,959 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695283352858Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695283352939 (+81 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695283352939Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695283352939Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695283352944 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695283352952 (+8 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695283352958 (+6 ms) 2023-09-21 08:02:32,961 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 08:02:32,962 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-21 08:02:32,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-21 08:02:32,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-21 08:02:32,963 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 103 msec 2023-09-21 08:02:32,965 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40677] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1695283352202.2ae81a6c20365c6f7479d10ef3553215. with WAL disabled. Data may be lost in the event of a crash. 2023-09-21 08:02:32,966 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1695283352202.edf7ebbff8d0ead21dca48b0cf162774. with WAL disabled. Data may be lost in the event of a crash. 2023-09-21 08:02:32,969 DEBUG [Listener at jenkins-hbase4.apache.org/40119] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:32,969 DEBUG [Listener at jenkins-hbase4.apache.org/40119] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695283352202.2ae81a6c20365c6f7479d10ef3553215. 2023-09-21 08:02:32,969 INFO [Listener at jenkins-hbase4.apache.org/40119] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-21 08:02:32,979 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-21 08:02:32,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695283352979 (current time:1695283352979). 2023-09-21 08:02:32,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-21 08:02:32,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(139): Connect 0x02ba833f to 127.0.0.1:58708 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 08:02:32,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@39b9ab64, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 08:02:32,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:02:32,993 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56418, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:02:32,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x02ba833f to 127.0.0.1:58708 2023-09-21 08:02:32,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 08:02:32,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(139): Connect 0x5939beda to 127.0.0.1:58708 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 08:02:33,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@fcc6db9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 08:02:33,002 DEBUG [hconnection-0x7bda05af-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:02:33,005 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56430, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:02:33,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:02:33,011 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37886, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:02:33,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5939beda to 127.0.0.1:58708 2023-09-21 08:02:33,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 08:02:33,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-21 08:02:33,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-21 08:02:33,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-21 08:02:33,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-21 08:02:33,017 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-21 08:02:33,017 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695283953017 2023-09-21 08:02:33,017 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-21 08:02:33,019 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-21 08:02:33,019 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-21 08:02:33,019 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-21 08:02:33,020 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-21 08:02:33,021 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-21 08:02:33,022 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-21 08:02:33,022 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695283953022 2023-09-21 08:02:33,032 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,032 INFO [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-21 08:02:33,032 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:02:33,034 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-21 08:02:33,034 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-21 08:02:33,034 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,034 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,036 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:33,036 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:33,036 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:33,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:33,036 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:33,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:33,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:33,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:33,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:33,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:33,037 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:33,037 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:33,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,037 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:33,037 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-21 08:02:33,037 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,037 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,038 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-21 08:02:33,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-21 08:02:33,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-21 08:02:33,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,038 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-21 08:02:33,038 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-21 08:02:33,038 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-21 08:02:33,038 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,038 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,038 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,038 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-21 08:02:33,038 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-21 08:02:33,038 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:02:33,038 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-21 08:02:33,040 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-21 08:02:33,040 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-21 08:02:33,040 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:02:33,038 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:02:33,041 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-21 08:02:33,041 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-21 08:02:33,041 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-21 08:02:33,041 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36469,1695283279785' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-21 08:02:33,040 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43299,1695283279840' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-21 08:02:33,042 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-21 08:02:33,042 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40677,1695283279880' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-21 08:02:33,044 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,045 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:33,045 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,045 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:33,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:33,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:02:33,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:02:33,045 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,045 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,045 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,045 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 08:02:33,045 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 08:02:33,045 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,045 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 08:02:33,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:02:33,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:02:33,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:33,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:33,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:33,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:02:33,047 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43299,1695283279840' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-21 08:02:33,047 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56e9f30a[Count = 1] remaining members to acquire global barrier 2023-09-21 08:02:33,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:33,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:02:33,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:02:33,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:02:33,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:02:33,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:33,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:33,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:33,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:02:33,049 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40677,1695283279880' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-21 08:02:33,049 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56e9f30a[Count = 0] remaining members to acquire global barrier 2023-09-21 08:02:33,049 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-21 08:02:33,049 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,051 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,051 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,051 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,051 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-21 08:02:33,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,051 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:33,051 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 08:02:33,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,051 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 08:02:33,051 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-21 08:02:33,051 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695283352202.edf7ebbff8d0ead21dca48b0cf162774. 2023-09-21 08:02:33,051 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-21 08:02:33,052 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:33,052 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 08:02:33,052 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695283352202.2ae81a6c20365c6f7479d10ef3553215. 2023-09-21 08:02:33,052 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-21 08:02:33,052 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695283352202.2ae81a6c20365c6f7479d10ef3553215. started... 2023-09-21 08:02:33,052 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695283352202.edf7ebbff8d0ead21dca48b0cf162774. started... 2023-09-21 08:02:33,052 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,36469,1695283279785' in zk 2023-09-21 08:02:33,052 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 08:02:33,052 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-21 08:02:33,052 INFO [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2ae81a6c20365c6f7479d10ef3553215 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-21 08:02:33,052 INFO [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] regionserver.HRegion(2745): Flushing edf7ebbff8d0ead21dca48b0cf162774 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-21 08:02:33,055 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-21 08:02:33,055 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:02:33,055 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-21 08:02:33,075 INFO [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023092163e1c3bab691423396a254350031f91e to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023092163e1c3bab691423396a254350031f91e 2023-09-21 08:02:33,075 INFO [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230921c97e8aa4a6054250979535aae643f2ce to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230921c97e8aa4a6054250979535aae643f2ce 2023-09-21 08:02:33,082 INFO [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion/2ae81a6c20365c6f7479d10ef3553215/.tmp/cf/c679f68aa1fe4978b9b946249b5056e2 2023-09-21 08:02:33,083 INFO [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion/edf7ebbff8d0ead21dca48b0cf162774/.tmp/cf/b319b9bf6e124b1694488022babe9ca3 2023-09-21 08:02:33,088 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion/2ae81a6c20365c6f7479d10ef3553215/.tmp/cf/c679f68aa1fe4978b9b946249b5056e2 as hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion/2ae81a6c20365c6f7479d10ef3553215/cf/c679f68aa1fe4978b9b946249b5056e2 2023-09-21 08:02:33,088 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion/edf7ebbff8d0ead21dca48b0cf162774/.tmp/cf/b319b9bf6e124b1694488022babe9ca3 as hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion/edf7ebbff8d0ead21dca48b0cf162774/cf/b319b9bf6e124b1694488022babe9ca3 2023-09-21 08:02:33,093 INFO [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion/edf7ebbff8d0ead21dca48b0cf162774/cf/b319b9bf6e124b1694488022babe9ca3, entries=46, sequenceid=6, filesize=13.4 K 2023-09-21 08:02:33,094 INFO [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion/2ae81a6c20365c6f7479d10ef3553215/cf/c679f68aa1fe4978b9b946249b5056e2, entries=4, sequenceid=6, filesize=5.6 K 2023-09-21 08:02:33,094 INFO [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for edf7ebbff8d0ead21dca48b0cf162774 in 42ms, sequenceid=6, compaction requested=false 2023-09-21 08:02:33,094 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-21 08:02:33,095 INFO [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 2ae81a6c20365c6f7479d10ef3553215 in 43ms, sequenceid=6, compaction requested=false 2023-09-21 08:02:33,095 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-21 08:02:33,097 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for edf7ebbff8d0ead21dca48b0cf162774: 2023-09-21 08:02:33,097 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2ae81a6c20365c6f7479d10ef3553215: 2023-09-21 08:02:33,098 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695283352202.edf7ebbff8d0ead21dca48b0cf162774.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,098 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695283352202.2ae81a6c20365c6f7479d10ef3553215.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,098 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 08:02:33,098 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 08:02:33,098 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion/edf7ebbff8d0ead21dca48b0cf162774/cf/b319b9bf6e124b1694488022babe9ca3] hfiles 2023-09-21 08:02:33,098 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion/2ae81a6c20365c6f7479d10ef3553215/cf/c679f68aa1fe4978b9b946249b5056e2] hfiles 2023-09-21 08:02:33,098 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion/2ae81a6c20365c6f7479d10ef3553215/cf/c679f68aa1fe4978b9b946249b5056e2 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,098 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion/edf7ebbff8d0ead21dca48b0cf162774/cf/b319b9bf6e124b1694488022babe9ca3 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,108 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695283352202.edf7ebbff8d0ead21dca48b0cf162774. completed. 2023-09-21 08:02:33,108 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695283352202.edf7ebbff8d0ead21dca48b0cf162774. 2023-09-21 08:02:33,108 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 08:02:33,108 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 08:02:33,108 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:33,108 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-21 08:02:33,108 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43299,1695283279840' in zk 2023-09-21 08:02:33,109 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695283352202.2ae81a6c20365c6f7479d10ef3553215. completed. 2023-09-21 08:02:33,109 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695283352202.2ae81a6c20365c6f7479d10ef3553215. 2023-09-21 08:02:33,109 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 08:02:33,109 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 08:02:33,109 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:33,109 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-21 08:02:33,109 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40677,1695283279880' in zk 2023-09-21 08:02:33,110 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-21 08:02:33,110 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:33,110 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:02:33,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:33,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:02:33,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:02:33,110 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-21 08:02:33,112 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:33,112 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-21 08:02:33,112 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:02:33,112 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-21 08:02:33,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:02:33,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:02:33,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:33,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:33,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:33,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:02:33,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:33,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:33,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:33,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43299,1695283279840': 2023-09-21 08:02:33,116 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43299,1695283279840' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-21 08:02:33,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:33,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:02:33,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:02:33,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:02:33,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:02:33,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:33,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:33,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:33,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:02:33,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:33,119 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 08:02:33,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:33,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:33,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-21 08:02:33,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-21 08:02:33,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40677,1695283279880': 2023-09-21 08:02:33,120 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40677,1695283279880' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-21 08:02:33,120 INFO [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-21 08:02:33,120 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-21 08:02:33,120 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-21 08:02:33,120 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-21 08:02:33,120 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,120 INFO [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-21 08:02:33,126 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,126 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,126 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:02:33,126 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,126 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,126 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:02:33,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,126 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:02:33,126 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:33,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:02:33,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:02:33,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:02:33,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:02:33,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:02:33,127 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:33,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:02:33,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:02:33,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:02:33,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:02:33,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,127 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:33,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:02:33,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:33,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:33,129 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:33,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:33,129 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:33,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:02:33,130 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:33,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:33,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:33,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:33,132 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:33,132 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:33,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:33,133 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,132 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:33,133 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:33,133 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,133 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:02:33,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:33,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:33,133 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:02:33,132 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:33,132 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:02:33,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:33,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:02:33,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:33,135 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:02:33,133 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-21 08:02:33,133 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:02:33,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:02:33,135 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:33,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:02:33,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:02:33,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:02:33,135 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:33,135 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,136 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:33,136 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,136 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:33,136 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:33,136 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,136 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,136 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023092163e1c3bab691423396a254350031f91e, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230921c97e8aa4a6054250979535aae643f2ce] mob files 2023-09-21 08:02:33,136 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023092163e1c3bab691423396a254350031f91e 2023-09-21 08:02:33,136 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230921c97e8aa4a6054250979535aae643f2ce 2023-09-21 08:02:33,148 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,149 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,172 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,173 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-21 08:02:33,173 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,173 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:33,174 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695283353017Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695283353148 (+131 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695283353148Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1695283353148Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1695283353153 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695283353164 (+11 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695283353173 (+9 ms) 2023-09-21 08:02:33,177 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-21 08:02:33,178 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 159 msec 2023-09-21 08:02:33,320 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 08:02:33,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-21 08:02:33,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-21 08:02:33,349 DEBUG [Listener at jenkins-hbase4.apache.org/40119] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-21 08:02:33,353 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56446, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-21 08:02:33,354 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36469] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-21 08:02:33,355 DEBUG [Listener at jenkins-hbase4.apache.org/40119] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-21 08:02:33,359 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39644, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-21 08:02:33,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40677] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-21 08:02:33,360 DEBUG [Listener at jenkins-hbase4.apache.org/40119] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-21 08:02:33,362 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37890, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-21 08:02:33,362 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-21 08:02:33,364 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-21 08:02:33,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:33,366 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-21 08:02:33,367 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-21 08:02:33,367 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-21 08:02:33,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-21 08:02:33,369 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/50bfdaf8f6036db28700eb9f823f8ee3 2023-09-21 08:02:33,369 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4e283128865c4bdf9f0bb0216dcf0a7 2023-09-21 08:02:33,370 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/50bfdaf8f6036db28700eb9f823f8ee3 empty. 2023-09-21 08:02:33,370 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4e283128865c4bdf9f0bb0216dcf0a7 empty. 2023-09-21 08:02:33,370 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/50bfdaf8f6036db28700eb9f823f8ee3 2023-09-21 08:02:33,370 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4e283128865c4bdf9f0bb0216dcf0a7 2023-09-21 08:02:33,370 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-21 08:02:33,380 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-21 08:02:33,381 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => c4e283128865c4bdf9f0bb0216dcf0a7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695283353364.c4e283128865c4bdf9f0bb0216dcf0a7.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp 2023-09-21 08:02:33,381 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 50bfdaf8f6036db28700eb9f823f8ee3, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353364.50bfdaf8f6036db28700eb9f823f8ee3.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp 2023-09-21 08:02:33,390 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353364.50bfdaf8f6036db28700eb9f823f8ee3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 08:02:33,390 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695283353364.c4e283128865c4bdf9f0bb0216dcf0a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 08:02:33,390 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 50bfdaf8f6036db28700eb9f823f8ee3, disabling compactions & flushes 2023-09-21 08:02:33,390 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing c4e283128865c4bdf9f0bb0216dcf0a7, disabling compactions & flushes 2023-09-21 08:02:33,390 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353364.50bfdaf8f6036db28700eb9f823f8ee3. 2023-09-21 08:02:33,391 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353364.50bfdaf8f6036db28700eb9f823f8ee3. 2023-09-21 08:02:33,391 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695283353364.c4e283128865c4bdf9f0bb0216dcf0a7. 2023-09-21 08:02:33,391 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353364.50bfdaf8f6036db28700eb9f823f8ee3. after waiting 0 ms 2023-09-21 08:02:33,391 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353364.50bfdaf8f6036db28700eb9f823f8ee3. 2023-09-21 08:02:33,391 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695283353364.c4e283128865c4bdf9f0bb0216dcf0a7. 2023-09-21 08:02:33,391 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353364.50bfdaf8f6036db28700eb9f823f8ee3. 2023-09-21 08:02:33,391 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695283353364.c4e283128865c4bdf9f0bb0216dcf0a7. after waiting 0 ms 2023-09-21 08:02:33,391 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695283353364.c4e283128865c4bdf9f0bb0216dcf0a7. 2023-09-21 08:02:33,391 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 50bfdaf8f6036db28700eb9f823f8ee3: 2023-09-21 08:02:33,391 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695283353364.c4e283128865c4bdf9f0bb0216dcf0a7. 2023-09-21 08:02:33,391 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for c4e283128865c4bdf9f0bb0216dcf0a7: 2023-09-21 08:02:33,393 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-21 08:02:33,394 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353364.50bfdaf8f6036db28700eb9f823f8ee3.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695283353394"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695283353394"}]},"ts":"1695283353394"} 2023-09-21 08:02:33,394 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695283353364.c4e283128865c4bdf9f0bb0216dcf0a7.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695283353394"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695283353394"}]},"ts":"1695283353394"} 2023-09-21 08:02:33,396 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-21 08:02:33,397 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-21 08:02:33,397 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695283353397"}]},"ts":"1695283353397"} 2023-09-21 08:02:33,398 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-21 08:02:33,401 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-21 08:02:33,403 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-21 08:02:33,403 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-21 08:02:33,403 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-21 08:02:33,403 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-21 08:02:33,403 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=50bfdaf8f6036db28700eb9f823f8ee3, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c4e283128865c4bdf9f0bb0216dcf0a7, ASSIGN}] 2023-09-21 08:02:33,406 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c4e283128865c4bdf9f0bb0216dcf0a7, ASSIGN 2023-09-21 08:02:33,406 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=50bfdaf8f6036db28700eb9f823f8ee3, ASSIGN 2023-09-21 08:02:33,406 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=50bfdaf8f6036db28700eb9f823f8ee3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43299,1695283279840; forceNewPlan=false, retain=false 2023-09-21 08:02:33,406 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c4e283128865c4bdf9f0bb0216dcf0a7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36469,1695283279785; forceNewPlan=false, retain=false 2023-09-21 08:02:33,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-21 08:02:33,557 INFO [jenkins-hbase4:34581] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-21 08:02:33,559 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=50bfdaf8f6036db28700eb9f823f8ee3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:33,559 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=c4e283128865c4bdf9f0bb0216dcf0a7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:33,560 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353364.50bfdaf8f6036db28700eb9f823f8ee3.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695283353559"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695283353559"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695283353559"}]},"ts":"1695283353559"} 2023-09-21 08:02:33,560 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695283353364.c4e283128865c4bdf9f0bb0216dcf0a7.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695283353559"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695283353559"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695283353559"}]},"ts":"1695283353559"} 2023-09-21 08:02:33,561 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 50bfdaf8f6036db28700eb9f823f8ee3, server=jenkins-hbase4.apache.org,43299,1695283279840}] 2023-09-21 08:02:33,562 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure c4e283128865c4bdf9f0bb0216dcf0a7, server=jenkins-hbase4.apache.org,36469,1695283279785}] 2023-09-21 08:02:33,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-21 08:02:33,716 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353364.50bfdaf8f6036db28700eb9f823f8ee3. 2023-09-21 08:02:33,716 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1695283353364.c4e283128865c4bdf9f0bb0216dcf0a7. 2023-09-21 08:02:33,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 50bfdaf8f6036db28700eb9f823f8ee3, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353364.50bfdaf8f6036db28700eb9f823f8ee3.', STARTKEY => '', ENDKEY => '2'} 2023-09-21 08:02:33,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c4e283128865c4bdf9f0bb0216dcf0a7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695283353364.c4e283128865c4bdf9f0bb0216dcf0a7.', STARTKEY => '2', ENDKEY => ''} 2023-09-21 08:02:33,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353364.50bfdaf8f6036db28700eb9f823f8ee3. service=AccessControlService 2023-09-21 08:02:33,717 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 08:02:33,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 50bfdaf8f6036db28700eb9f823f8ee3 2023-09-21 08:02:33,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353364.50bfdaf8f6036db28700eb9f823f8ee3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 08:02:33,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 50bfdaf8f6036db28700eb9f823f8ee3 2023-09-21 08:02:33,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 50bfdaf8f6036db28700eb9f823f8ee3 2023-09-21 08:02:33,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1695283353364.c4e283128865c4bdf9f0bb0216dcf0a7. service=AccessControlService 2023-09-21 08:02:33,717 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 08:02:33,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 c4e283128865c4bdf9f0bb0216dcf0a7 2023-09-21 08:02:33,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695283353364.c4e283128865c4bdf9f0bb0216dcf0a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 08:02:33,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c4e283128865c4bdf9f0bb0216dcf0a7 2023-09-21 08:02:33,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c4e283128865c4bdf9f0bb0216dcf0a7 2023-09-21 08:02:33,718 INFO [StoreOpener-50bfdaf8f6036db28700eb9f823f8ee3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 50bfdaf8f6036db28700eb9f823f8ee3 2023-09-21 08:02:33,719 INFO [StoreOpener-c4e283128865c4bdf9f0bb0216dcf0a7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c4e283128865c4bdf9f0bb0216dcf0a7 2023-09-21 08:02:33,719 DEBUG [StoreOpener-50bfdaf8f6036db28700eb9f823f8ee3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/50bfdaf8f6036db28700eb9f823f8ee3/cf 2023-09-21 08:02:33,720 DEBUG [StoreOpener-50bfdaf8f6036db28700eb9f823f8ee3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/50bfdaf8f6036db28700eb9f823f8ee3/cf 2023-09-21 08:02:33,720 DEBUG [StoreOpener-c4e283128865c4bdf9f0bb0216dcf0a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4e283128865c4bdf9f0bb0216dcf0a7/cf 2023-09-21 08:02:33,720 DEBUG [StoreOpener-c4e283128865c4bdf9f0bb0216dcf0a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4e283128865c4bdf9f0bb0216dcf0a7/cf 2023-09-21 08:02:33,720 INFO [StoreOpener-50bfdaf8f6036db28700eb9f823f8ee3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 50bfdaf8f6036db28700eb9f823f8ee3 columnFamilyName cf 2023-09-21 08:02:33,720 INFO [StoreOpener-c4e283128865c4bdf9f0bb0216dcf0a7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c4e283128865c4bdf9f0bb0216dcf0a7 columnFamilyName cf 2023-09-21 08:02:33,721 INFO [StoreOpener-50bfdaf8f6036db28700eb9f823f8ee3-1] regionserver.HStore(310): Store=50bfdaf8f6036db28700eb9f823f8ee3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 08:02:33,721 INFO [StoreOpener-c4e283128865c4bdf9f0bb0216dcf0a7-1] regionserver.HStore(310): Store=c4e283128865c4bdf9f0bb0216dcf0a7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 08:02:33,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4e283128865c4bdf9f0bb0216dcf0a7 2023-09-21 08:02:33,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/50bfdaf8f6036db28700eb9f823f8ee3 2023-09-21 08:02:33,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4e283128865c4bdf9f0bb0216dcf0a7 2023-09-21 08:02:33,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/50bfdaf8f6036db28700eb9f823f8ee3 2023-09-21 08:02:33,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c4e283128865c4bdf9f0bb0216dcf0a7 2023-09-21 08:02:33,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 50bfdaf8f6036db28700eb9f823f8ee3 2023-09-21 08:02:33,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4e283128865c4bdf9f0bb0216dcf0a7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-21 08:02:33,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/50bfdaf8f6036db28700eb9f823f8ee3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-21 08:02:33,727 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 50bfdaf8f6036db28700eb9f823f8ee3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63075505, jitterRate=-0.06010173261165619}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-21 08:02:33,727 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c4e283128865c4bdf9f0bb0216dcf0a7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60145036, jitterRate=-0.10376912355422974}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-21 08:02:33,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 50bfdaf8f6036db28700eb9f823f8ee3: 2023-09-21 08:02:33,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c4e283128865c4bdf9f0bb0216dcf0a7: 2023-09-21 08:02:33,728 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353364.50bfdaf8f6036db28700eb9f823f8ee3., pid=69, masterSystemTime=1695283353713 2023-09-21 08:02:33,728 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695283353364.c4e283128865c4bdf9f0bb0216dcf0a7., pid=70, masterSystemTime=1695283353713 2023-09-21 08:02:33,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353364.50bfdaf8f6036db28700eb9f823f8ee3. 2023-09-21 08:02:33,730 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353364.50bfdaf8f6036db28700eb9f823f8ee3. 2023-09-21 08:02:33,730 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=50bfdaf8f6036db28700eb9f823f8ee3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:33,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695283353364.c4e283128865c4bdf9f0bb0216dcf0a7. 2023-09-21 08:02:33,730 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353364.50bfdaf8f6036db28700eb9f823f8ee3.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695283353730"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695283353730"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695283353730"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695283353730"}]},"ts":"1695283353730"} 2023-09-21 08:02:33,731 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1695283353364.c4e283128865c4bdf9f0bb0216dcf0a7. 2023-09-21 08:02:33,731 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=c4e283128865c4bdf9f0bb0216dcf0a7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:33,731 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695283353364.c4e283128865c4bdf9f0bb0216dcf0a7.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695283353731"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695283353731"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695283353731"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695283353731"}]},"ts":"1695283353731"} 2023-09-21 08:02:33,734 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-09-21 08:02:33,734 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 50bfdaf8f6036db28700eb9f823f8ee3, server=jenkins-hbase4.apache.org,43299,1695283279840 in 171 msec 2023-09-21 08:02:33,734 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=68 2023-09-21 08:02:33,734 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure c4e283128865c4bdf9f0bb0216dcf0a7, server=jenkins-hbase4.apache.org,36469,1695283279785 in 171 msec 2023-09-21 08:02:33,735 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=50bfdaf8f6036db28700eb9f823f8ee3, ASSIGN in 331 msec 2023-09-21 08:02:33,736 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=66 2023-09-21 08:02:33,736 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c4e283128865c4bdf9f0bb0216dcf0a7, ASSIGN in 331 msec 2023-09-21 08:02:33,737 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-21 08:02:33,737 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695283353737"}]},"ts":"1695283353737"} 2023-09-21 08:02:33,738 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-21 08:02:33,741 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-21 08:02:33,742 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-21 08:02:33,743 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43299] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-21 08:02:33,745 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:02:33,745 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:02:33,745 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:02:33,745 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:02:33,747 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-21 08:02:33,747 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-21 08:02:33,747 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-21 08:02:33,747 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-21 08:02:33,747 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-21 08:02:33,747 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-21 08:02:33,747 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-21 08:02:33,747 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-21 08:02:33,749 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 383 msec 2023-09-21 08:02:33,829 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-21 08:02:33,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-21 08:02:33,972 INFO [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-21 08:02:33,994 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 50bfdaf8f6036db28700eb9f823f8ee3, c4e283128865c4bdf9f0bb0216dcf0a7 2023-09-21 08:02:34,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[50bfdaf8f6036db28700eb9f823f8ee3, c4e283128865c4bdf9f0bb0216dcf0a7], force=true 2023-09-21 08:02:34,005 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[50bfdaf8f6036db28700eb9f823f8ee3, c4e283128865c4bdf9f0bb0216dcf0a7], force=true 2023-09-21 08:02:34,005 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[50bfdaf8f6036db28700eb9f823f8ee3, c4e283128865c4bdf9f0bb0216dcf0a7], force=true 2023-09-21 08:02:34,005 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[50bfdaf8f6036db28700eb9f823f8ee3, c4e283128865c4bdf9f0bb0216dcf0a7], force=true 2023-09-21 08:02:34,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-21 08:02:34,029 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=50bfdaf8f6036db28700eb9f823f8ee3, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c4e283128865c4bdf9f0bb0216dcf0a7, UNASSIGN}] 2023-09-21 08:02:34,031 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=50bfdaf8f6036db28700eb9f823f8ee3, UNASSIGN 2023-09-21 08:02:34,031 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c4e283128865c4bdf9f0bb0216dcf0a7, UNASSIGN 2023-09-21 08:02:34,032 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=50bfdaf8f6036db28700eb9f823f8ee3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:34,032 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=c4e283128865c4bdf9f0bb0216dcf0a7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:34,032 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353364.50bfdaf8f6036db28700eb9f823f8ee3.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695283354032"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695283354032"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695283354032"}]},"ts":"1695283354032"} 2023-09-21 08:02:34,032 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695283353364.c4e283128865c4bdf9f0bb0216dcf0a7.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695283354032"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695283354032"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695283354032"}]},"ts":"1695283354032"} 2023-09-21 08:02:34,033 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 50bfdaf8f6036db28700eb9f823f8ee3, server=jenkins-hbase4.apache.org,43299,1695283279840}] 2023-09-21 08:02:34,034 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure c4e283128865c4bdf9f0bb0216dcf0a7, server=jenkins-hbase4.apache.org,36469,1695283279785}] 2023-09-21 08:02:34,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-21 08:02:34,185 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 50bfdaf8f6036db28700eb9f823f8ee3 2023-09-21 08:02:34,185 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c4e283128865c4bdf9f0bb0216dcf0a7 2023-09-21 08:02:34,187 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 50bfdaf8f6036db28700eb9f823f8ee3, disabling compactions & flushes 2023-09-21 08:02:34,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c4e283128865c4bdf9f0bb0216dcf0a7, disabling compactions & flushes 2023-09-21 08:02:34,188 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353364.50bfdaf8f6036db28700eb9f823f8ee3. 2023-09-21 08:02:34,188 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695283353364.c4e283128865c4bdf9f0bb0216dcf0a7. 2023-09-21 08:02:34,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353364.50bfdaf8f6036db28700eb9f823f8ee3. 2023-09-21 08:02:34,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695283353364.c4e283128865c4bdf9f0bb0216dcf0a7. 2023-09-21 08:02:34,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353364.50bfdaf8f6036db28700eb9f823f8ee3. after waiting 0 ms 2023-09-21 08:02:34,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353364.50bfdaf8f6036db28700eb9f823f8ee3. 2023-09-21 08:02:34,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695283353364.c4e283128865c4bdf9f0bb0216dcf0a7. after waiting 0 ms 2023-09-21 08:02:34,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695283353364.c4e283128865c4bdf9f0bb0216dcf0a7. 2023-09-21 08:02:34,188 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 50bfdaf8f6036db28700eb9f823f8ee3 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-21 08:02:34,188 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing c4e283128865c4bdf9f0bb0216dcf0a7 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-21 08:02:34,199 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4e283128865c4bdf9f0bb0216dcf0a7/.tmp/cf/de232a6213de41048854679dacdf11b9 2023-09-21 08:02:34,199 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/50bfdaf8f6036db28700eb9f823f8ee3/.tmp/cf/9cef1dc9a5f740a995e62b042ed83237 2023-09-21 08:02:34,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4e283128865c4bdf9f0bb0216dcf0a7/.tmp/cf/de232a6213de41048854679dacdf11b9 as hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4e283128865c4bdf9f0bb0216dcf0a7/cf/de232a6213de41048854679dacdf11b9 2023-09-21 08:02:34,206 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/50bfdaf8f6036db28700eb9f823f8ee3/.tmp/cf/9cef1dc9a5f740a995e62b042ed83237 as hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/50bfdaf8f6036db28700eb9f823f8ee3/cf/9cef1dc9a5f740a995e62b042ed83237 2023-09-21 08:02:34,210 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4e283128865c4bdf9f0bb0216dcf0a7/cf/de232a6213de41048854679dacdf11b9, entries=1, sequenceid=5, filesize=4.7 K 2023-09-21 08:02:34,211 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for c4e283128865c4bdf9f0bb0216dcf0a7 in 23ms, sequenceid=5, compaction requested=false 2023-09-21 08:02:34,216 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/50bfdaf8f6036db28700eb9f823f8ee3/cf/9cef1dc9a5f740a995e62b042ed83237, entries=1, sequenceid=5, filesize=4.7 K 2023-09-21 08:02:34,216 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 50bfdaf8f6036db28700eb9f823f8ee3 in 28ms, sequenceid=5, compaction requested=false 2023-09-21 08:02:34,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4e283128865c4bdf9f0bb0216dcf0a7/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-21 08:02:34,225 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 08:02:34,225 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695283353364.c4e283128865c4bdf9f0bb0216dcf0a7. 2023-09-21 08:02:34,225 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c4e283128865c4bdf9f0bb0216dcf0a7: 2023-09-21 08:02:34,226 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c4e283128865c4bdf9f0bb0216dcf0a7 2023-09-21 08:02:34,227 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=c4e283128865c4bdf9f0bb0216dcf0a7, regionState=CLOSED 2023-09-21 08:02:34,227 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/50bfdaf8f6036db28700eb9f823f8ee3/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-21 08:02:34,227 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695283353364.c4e283128865c4bdf9f0bb0216dcf0a7.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695283354227"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695283354227"}]},"ts":"1695283354227"} 2023-09-21 08:02:34,227 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 08:02:34,227 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353364.50bfdaf8f6036db28700eb9f823f8ee3. 2023-09-21 08:02:34,227 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 50bfdaf8f6036db28700eb9f823f8ee3: 2023-09-21 08:02:34,229 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 50bfdaf8f6036db28700eb9f823f8ee3 2023-09-21 08:02:34,229 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=50bfdaf8f6036db28700eb9f823f8ee3, regionState=CLOSED 2023-09-21 08:02:34,229 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353364.50bfdaf8f6036db28700eb9f823f8ee3.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695283354229"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695283354229"}]},"ts":"1695283354229"} 2023-09-21 08:02:34,230 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-09-21 08:02:34,230 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure c4e283128865c4bdf9f0bb0216dcf0a7, server=jenkins-hbase4.apache.org,36469,1695283279785 in 194 msec 2023-09-21 08:02:34,231 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c4e283128865c4bdf9f0bb0216dcf0a7, UNASSIGN in 201 msec 2023-09-21 08:02:34,232 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-09-21 08:02:34,232 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 50bfdaf8f6036db28700eb9f823f8ee3, server=jenkins-hbase4.apache.org,43299,1695283279840 in 197 msec 2023-09-21 08:02:34,233 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-09-21 08:02:34,233 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=50bfdaf8f6036db28700eb9f823f8ee3, UNASSIGN in 206 msec 2023-09-21 08:02:34,273 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed5e480b1fc9e79fa3d1c13f133eb34b/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-21 08:02:34,275 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353364.50bfdaf8f6036db28700eb9f823f8ee3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-21 08:02:34,275 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695283353364.c4e283128865c4bdf9f0bb0216dcf0a7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-21 08:02:34,275 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353365.ed5e480b1fc9e79fa3d1c13f133eb34b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-21 08:02:34,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-21 08:02:34,324 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ed5e480b1fc9e79fa3d1c13f133eb34b, ASSIGN}] 2023-09-21 08:02:34,325 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ed5e480b1fc9e79fa3d1c13f133eb34b, ASSIGN 2023-09-21 08:02:34,326 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ed5e480b1fc9e79fa3d1c13f133eb34b, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,43299,1695283279840; forceNewPlan=false, retain=false 2023-09-21 08:02:34,476 INFO [jenkins-hbase4:34581] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-21 08:02:34,478 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=ed5e480b1fc9e79fa3d1c13f133eb34b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:34,478 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353365.ed5e480b1fc9e79fa3d1c13f133eb34b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695283354478"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695283354478"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695283354478"}]},"ts":"1695283354478"} 2023-09-21 08:02:34,480 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure ed5e480b1fc9e79fa3d1c13f133eb34b, server=jenkins-hbase4.apache.org,43299,1695283279840}] 2023-09-21 08:02:34,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-21 08:02:34,635 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353365.ed5e480b1fc9e79fa3d1c13f133eb34b. 2023-09-21 08:02:34,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ed5e480b1fc9e79fa3d1c13f133eb34b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353365.ed5e480b1fc9e79fa3d1c13f133eb34b.', STARTKEY => '', ENDKEY => ''} 2023-09-21 08:02:34,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353365.ed5e480b1fc9e79fa3d1c13f133eb34b. service=AccessControlService 2023-09-21 08:02:34,635 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 08:02:34,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 ed5e480b1fc9e79fa3d1c13f133eb34b 2023-09-21 08:02:34,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353365.ed5e480b1fc9e79fa3d1c13f133eb34b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 08:02:34,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ed5e480b1fc9e79fa3d1c13f133eb34b 2023-09-21 08:02:34,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ed5e480b1fc9e79fa3d1c13f133eb34b 2023-09-21 08:02:34,636 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed5e480b1fc9e79fa3d1c13f133eb34b/.regioninfo 2023-09-21 08:02:34,648 INFO [StoreOpener-ed5e480b1fc9e79fa3d1c13f133eb34b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ed5e480b1fc9e79fa3d1c13f133eb34b 2023-09-21 08:02:34,649 DEBUG [StoreOpener-ed5e480b1fc9e79fa3d1c13f133eb34b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed5e480b1fc9e79fa3d1c13f133eb34b/cf 2023-09-21 08:02:34,649 DEBUG [StoreOpener-ed5e480b1fc9e79fa3d1c13f133eb34b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed5e480b1fc9e79fa3d1c13f133eb34b/cf 2023-09-21 08:02:34,650 INFO [StoreOpener-ed5e480b1fc9e79fa3d1c13f133eb34b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ed5e480b1fc9e79fa3d1c13f133eb34b columnFamilyName cf 2023-09-21 08:02:34,677 DEBUG [StoreOpener-ed5e480b1fc9e79fa3d1c13f133eb34b-1] regionserver.HStore(539): loaded hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed5e480b1fc9e79fa3d1c13f133eb34b/cf/9cef1dc9a5f740a995e62b042ed83237.50bfdaf8f6036db28700eb9f823f8ee3->hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/50bfdaf8f6036db28700eb9f823f8ee3/cf/9cef1dc9a5f740a995e62b042ed83237-top 2023-09-21 08:02:34,682 DEBUG [StoreOpener-ed5e480b1fc9e79fa3d1c13f133eb34b-1] regionserver.HStore(539): loaded hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed5e480b1fc9e79fa3d1c13f133eb34b/cf/de232a6213de41048854679dacdf11b9.c4e283128865c4bdf9f0bb0216dcf0a7->hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4e283128865c4bdf9f0bb0216dcf0a7/cf/de232a6213de41048854679dacdf11b9-top 2023-09-21 08:02:34,683 INFO [StoreOpener-ed5e480b1fc9e79fa3d1c13f133eb34b-1] regionserver.HStore(310): Store=ed5e480b1fc9e79fa3d1c13f133eb34b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 08:02:34,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed5e480b1fc9e79fa3d1c13f133eb34b 2023-09-21 08:02:34,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed5e480b1fc9e79fa3d1c13f133eb34b 2023-09-21 08:02:34,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ed5e480b1fc9e79fa3d1c13f133eb34b 2023-09-21 08:02:34,688 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ed5e480b1fc9e79fa3d1c13f133eb34b; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68225452, jitterRate=0.016638457775115967}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-21 08:02:34,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ed5e480b1fc9e79fa3d1c13f133eb34b: 2023-09-21 08:02:34,689 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353365.ed5e480b1fc9e79fa3d1c13f133eb34b., pid=77, masterSystemTime=1695283354631 2023-09-21 08:02:34,690 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353365.ed5e480b1fc9e79fa3d1c13f133eb34b.,because compaction is disabled. 2023-09-21 08:02:34,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353365.ed5e480b1fc9e79fa3d1c13f133eb34b. 2023-09-21 08:02:34,691 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353365.ed5e480b1fc9e79fa3d1c13f133eb34b. 2023-09-21 08:02:34,691 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=ed5e480b1fc9e79fa3d1c13f133eb34b, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:34,692 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353365.ed5e480b1fc9e79fa3d1c13f133eb34b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695283354691"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695283354691"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695283354691"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695283354691"}]},"ts":"1695283354691"} 2023-09-21 08:02:34,694 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-21 08:02:34,694 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure ed5e480b1fc9e79fa3d1c13f133eb34b, server=jenkins-hbase4.apache.org,43299,1695283279840 in 213 msec 2023-09-21 08:02:34,696 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-21 08:02:34,696 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ed5e480b1fc9e79fa3d1c13f133eb34b, ASSIGN in 370 msec 2023-09-21 08:02:34,697 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[50bfdaf8f6036db28700eb9f823f8ee3, c4e283128865c4bdf9f0bb0216dcf0a7], force=true in 698 msec 2023-09-21 08:02:35,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-21 08:02:35,113 INFO [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-21 08:02:35,114 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-21 08:02:35,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695283355114 (current time:1695283355114). 2023-09-21 08:02:35,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-21 08:02:35,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(139): Connect 0x3c3bb483 to 127.0.0.1:58708 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 08:02:35,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5cfc9b68, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 08:02:35,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:02:35,127 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56452, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:02:35,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c3bb483 to 127.0.0.1:58708 2023-09-21 08:02:35,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 08:02:35,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(139): Connect 0x0db9567b to 127.0.0.1:58708 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 08:02:35,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6cc764e3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 08:02:35,136 DEBUG [hconnection-0x54d885c8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:02:35,139 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56460, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:02:35,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:02:35,144 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37892, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:02:35,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0db9567b to 127.0.0.1:58708 2023-09-21 08:02:35,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 08:02:35,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-21 08:02:35,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-21 08:02:35,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-21 08:02:35,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-21 08:02:35,149 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-21 08:02:35,149 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1695283955149 2023-09-21 08:02:35,149 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-21 08:02:35,153 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-21 08:02:35,154 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-21 08:02:35,154 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-21 08:02:35,154 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-21 08:02:35,155 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 7 msec 2023-09-21 08:02:35,156 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-21 08:02:35,156 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1695283955156 2023-09-21 08:02:35,164 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,164 INFO [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-21 08:02:35,164 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:02:35,166 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-21 08:02:35,166 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-21 08:02:35,166 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,166 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,168 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:35,168 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:35,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:35,168 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:35,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:35,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:35,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:35,168 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:35,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:35,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:35,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,168 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:35,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,168 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,168 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-21 08:02:35,169 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-21 08:02:35,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,169 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,169 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-21 08:02:35,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-21 08:02:35,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,169 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,169 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-21 08:02:35,169 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-21 08:02:35,169 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:02:35,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-21 08:02:35,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,170 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-21 08:02:35,170 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,171 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,171 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-21 08:02:35,171 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-21 08:02:35,171 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:02:35,171 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-21 08:02:35,172 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-21 08:02:35,172 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-21 08:02:35,172 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-21 08:02:35,172 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43299,1695283279840' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-21 08:02:35,172 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40677,1695283279880' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-21 08:02:35,171 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:02:35,173 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-21 08:02:35,173 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-21 08:02:35,173 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36469,1695283279785' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-21 08:02:35,175 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:35,175 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:35,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:02:35,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:02:35,176 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,176 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:02:35,176 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,176 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 08:02:35,176 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,177 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:02:35,177 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 08:02:35,177 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 08:02:35,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:35,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:35,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:35,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:02:35,178 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43299,1695283279840' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-21 08:02:35,178 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5bcf0f3b[Count = 0] remaining members to acquire global barrier 2023-09-21 08:02:35,178 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-21 08:02:35,179 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,180 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,180 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,180 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,180 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-21 08:02:35,180 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:35,180 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-21 08:02:35,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,181 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-21 08:02:35,181 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-21 08:02:35,181 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-21 08:02:35,181 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,36469,1695283279785' in zk 2023-09-21 08:02:35,181 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353365.ed5e480b1fc9e79fa3d1c13f133eb34b. 2023-09-21 08:02:35,181 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 08:02:35,181 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 08:02:35,181 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353365.ed5e480b1fc9e79fa3d1c13f133eb34b. started... 2023-09-21 08:02:35,181 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-21 08:02:35,181 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,40677,1695283279880' in zk 2023-09-21 08:02:35,182 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ed5e480b1fc9e79fa3d1c13f133eb34b: 2023-09-21 08:02:35,182 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353365.ed5e480b1fc9e79fa3d1c13f133eb34b.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,182 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 08:02:35,183 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed5e480b1fc9e79fa3d1c13f133eb34b/cf/9cef1dc9a5f740a995e62b042ed83237.50bfdaf8f6036db28700eb9f823f8ee3->hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/50bfdaf8f6036db28700eb9f823f8ee3/cf/9cef1dc9a5f740a995e62b042ed83237-top, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed5e480b1fc9e79fa3d1c13f133eb34b/cf/de232a6213de41048854679dacdf11b9.c4e283128865c4bdf9f0bb0216dcf0a7->hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4e283128865c4bdf9f0bb0216dcf0a7/cf/de232a6213de41048854679dacdf11b9-top] hfiles 2023-09-21 08:02:35,183 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed5e480b1fc9e79fa3d1c13f133eb34b/cf/9cef1dc9a5f740a995e62b042ed83237.50bfdaf8f6036db28700eb9f823f8ee3 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,183 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-21 08:02:35,183 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:02:35,183 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-21 08:02:35,184 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed5e480b1fc9e79fa3d1c13f133eb34b/cf/de232a6213de41048854679dacdf11b9.c4e283128865c4bdf9f0bb0216dcf0a7 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,186 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-21 08:02:35,186 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:02:35,186 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-21 08:02:35,194 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353365.ed5e480b1fc9e79fa3d1c13f133eb34b. completed. 2023-09-21 08:02:35,194 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353365.ed5e480b1fc9e79fa3d1c13f133eb34b. 2023-09-21 08:02:35,194 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 08:02:35,194 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 08:02:35,194 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:35,194 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-21 08:02:35,194 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,43299,1695283279840' in zk 2023-09-21 08:02:35,200 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-21 08:02:35,200 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:35,200 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:02:35,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:35,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:02:35,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:02:35,200 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-21 08:02:35,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:02:35,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:02:35,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:35,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:35,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:35,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:02:35,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:35,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:35,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:35,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,43299,1695283279840': 2023-09-21 08:02:35,203 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43299,1695283279840' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-21 08:02:35,203 INFO [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-21 08:02:35,203 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-21 08:02:35,203 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-21 08:02:35,203 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,203 INFO [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-21 08:02:35,205 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,205 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:02:35,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:02:35,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,205 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:02:35,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,205 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,205 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:02:35,205 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:35,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,205 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:02:35,205 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:02:35,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:02:35,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:02:35,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:02:35,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:02:35,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:02:35,206 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:35,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:02:35,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:02:35,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,207 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:35,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:35,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:35,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:35,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:02:35,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,208 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:35,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:35,209 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:35,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:35,209 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:35,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:35,212 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:35,213 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:35,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:35,213 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:35,213 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:02:35,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:35,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:35,213 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:35,213 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,213 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:02:35,213 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,213 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:02:35,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:35,213 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:02:35,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:02:35,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:35,213 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:02:35,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:35,213 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:35,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:02:35,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:02:35,214 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:35,214 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,214 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:35,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:02:35,214 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,214 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,214 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:35,214 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:35,214 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,214 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:02:35,235 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,235 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-21 08:02:35,235 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,236 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,236 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1695283355150Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695283355213 (+63 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695283355213Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695283355217 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695283355225 (+8 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1695283355235 (+10 ms) 2023-09-21 08:02:35,239 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-21 08:02:35,240 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 86 msec 2023-09-21 08:02:35,254 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 08:02:35,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-21 08:02:35,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-21 08:02:35,255 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283355255 2023-09-21 08:02:35,255 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42401, tgtDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283355255, rawTgtDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283355255, srcFsUri=hdfs://localhost:42401, srcDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52 2023-09-21 08:02:35,278 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42401, inputRoot=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52 2023-09-21 08:02:35,278 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1748765475_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283355255, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283355255/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,278 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42401, inputRoot=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52, snapshotDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-21 08:02:35,286 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283355255/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:35,305 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:35,306 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:35,306 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:35,306 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:35,892 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695283286442_0004_000001 (auth:SIMPLE) 2023-09-21 08:02:36,188 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/hadoop-3830096379678931406.jar 2023-09-21 08:02:36,188 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:36,189 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:36,255 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/hadoop-3873082249625057393.jar 2023-09-21 08:02:36,256 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:36,256 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:36,256 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:36,257 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:36,257 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:36,257 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:36,258 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-21 08:02:36,258 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-21 08:02:36,258 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-21 08:02:36,259 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-21 08:02:36,259 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-21 08:02:36,260 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-21 08:02:36,260 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-21 08:02:36,260 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-21 08:02:36,260 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-21 08:02:36,261 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-21 08:02:36,262 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 08:02:36,262 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 08:02:36,262 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-21 08:02:36,263 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 08:02:36,263 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 08:02:36,263 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-21 08:02:36,264 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-21 08:02:36,619 WARN [Listener at jenkins-hbase4.apache.org/40119] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-21 08:02:36,621 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-21 08:02:36,623 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-21 08:02:36,678 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-21 08:02:36,678 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-21 08:02:36,896 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695283286442_0005_000001 (auth:SIMPLE) 2023-09-21 08:02:37,495 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-21 08:02:40,707 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695283286442_0005_000001 (auth:SIMPLE) 2023-09-21 08:02:42,919 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695283286442_0005_000001 (auth:SIMPLE) 2023-09-21 08:02:45,326 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695283286442_0005_000001 (auth:SIMPLE) 2023-09-21 08:02:46,782 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-21 08:02:46,787 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-21 08:02:46,796 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:46,796 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-21 08:02:46,796 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-21 08:02:46,796 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-501182444_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:46,797 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(367): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-21 08:02:46,797 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(367): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-21 08:02:46,797 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-501182444_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283355255/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283355255/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:46,797 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(367): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283355255/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-21 08:02:46,798 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(367): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283355255/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-21 08:02:46,803 INFO [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:46,804 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:46,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:46,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-21 08:02:46,808 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695283366808"}]},"ts":"1695283366808"} 2023-09-21 08:02:46,809 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-21 08:02:46,811 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-21 08:02:46,812 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ed5e480b1fc9e79fa3d1c13f133eb34b, UNASSIGN}] 2023-09-21 08:02:46,814 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ed5e480b1fc9e79fa3d1c13f133eb34b, UNASSIGN 2023-09-21 08:02:46,814 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=ed5e480b1fc9e79fa3d1c13f133eb34b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:46,814 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353365.ed5e480b1fc9e79fa3d1c13f133eb34b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695283366814"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695283366814"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695283366814"}]},"ts":"1695283366814"} 2023-09-21 08:02:46,816 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure ed5e480b1fc9e79fa3d1c13f133eb34b, server=jenkins-hbase4.apache.org,43299,1695283279840}] 2023-09-21 08:02:46,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-21 08:02:46,968 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ed5e480b1fc9e79fa3d1c13f133eb34b 2023-09-21 08:02:46,968 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ed5e480b1fc9e79fa3d1c13f133eb34b, disabling compactions & flushes 2023-09-21 08:02:46,968 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353365.ed5e480b1fc9e79fa3d1c13f133eb34b. 2023-09-21 08:02:46,968 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353365.ed5e480b1fc9e79fa3d1c13f133eb34b. 2023-09-21 08:02:46,968 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353365.ed5e480b1fc9e79fa3d1c13f133eb34b. after waiting 0 ms 2023-09-21 08:02:46,968 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353365.ed5e480b1fc9e79fa3d1c13f133eb34b. 2023-09-21 08:02:46,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed5e480b1fc9e79fa3d1c13f133eb34b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-21 08:02:46,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 08:02:46,983 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353365.ed5e480b1fc9e79fa3d1c13f133eb34b. 2023-09-21 08:02:46,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ed5e480b1fc9e79fa3d1c13f133eb34b: 2023-09-21 08:02:46,985 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ed5e480b1fc9e79fa3d1c13f133eb34b 2023-09-21 08:02:46,985 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=ed5e480b1fc9e79fa3d1c13f133eb34b, regionState=CLOSED 2023-09-21 08:02:46,985 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353365.ed5e480b1fc9e79fa3d1c13f133eb34b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695283366985"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695283366985"}]},"ts":"1695283366985"} 2023-09-21 08:02:46,988 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-21 08:02:46,988 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure ed5e480b1fc9e79fa3d1c13f133eb34b, server=jenkins-hbase4.apache.org,43299,1695283279840 in 170 msec 2023-09-21 08:02:46,989 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-21 08:02:46,989 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ed5e480b1fc9e79fa3d1c13f133eb34b, UNASSIGN in 176 msec 2023-09-21 08:02:46,990 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695283366990"}]},"ts":"1695283366990"} 2023-09-21 08:02:46,991 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-21 08:02:46,992 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-21 08:02:46,994 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 189 msec 2023-09-21 08:02:47,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-21 08:02:47,110 INFO [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-21 08:02:47,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:47,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:47,115 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:47,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:47,115 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:47,116 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43299] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:47,120 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4e283128865c4bdf9f0bb0216dcf0a7 2023-09-21 08:02:47,120 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed5e480b1fc9e79fa3d1c13f133eb34b 2023-09-21 08:02:47,120 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/50bfdaf8f6036db28700eb9f823f8ee3 2023-09-21 08:02:47,121 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:47,121 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:47,121 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:47,121 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:47,121 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-21 08:02:47,121 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-21 08:02:47,121 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-21 08:02:47,122 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4e283128865c4bdf9f0bb0216dcf0a7/cf, FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4e283128865c4bdf9f0bb0216dcf0a7/recovered.edits] 2023-09-21 08:02:47,122 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:47,122 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:02:47,122 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-09-21 08:02:47,122 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-21 08:02:47,122 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:02:47,122 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:47,122 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:47,123 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:02:47,123 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed5e480b1fc9e79fa3d1c13f133eb34b/cf, FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed5e480b1fc9e79fa3d1c13f133eb34b/recovered.edits] 2023-09-21 08:02:47,122 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:02:47,123 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/50bfdaf8f6036db28700eb9f823f8ee3/cf, FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/50bfdaf8f6036db28700eb9f823f8ee3/recovered.edits] 2023-09-21 08:02:47,123 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-21 08:02:47,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-21 08:02:47,124 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-21 08:02:47,124 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-21 08:02:47,124 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-21 08:02:47,127 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4e283128865c4bdf9f0bb0216dcf0a7/cf/de232a6213de41048854679dacdf11b9 to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4e283128865c4bdf9f0bb0216dcf0a7/cf/de232a6213de41048854679dacdf11b9 2023-09-21 08:02:47,128 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed5e480b1fc9e79fa3d1c13f133eb34b/cf/9cef1dc9a5f740a995e62b042ed83237.50bfdaf8f6036db28700eb9f823f8ee3 to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed5e480b1fc9e79fa3d1c13f133eb34b/cf/9cef1dc9a5f740a995e62b042ed83237.50bfdaf8f6036db28700eb9f823f8ee3 2023-09-21 08:02:47,128 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/50bfdaf8f6036db28700eb9f823f8ee3/cf/9cef1dc9a5f740a995e62b042ed83237 to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/50bfdaf8f6036db28700eb9f823f8ee3/cf/9cef1dc9a5f740a995e62b042ed83237 2023-09-21 08:02:47,129 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed5e480b1fc9e79fa3d1c13f133eb34b/cf/de232a6213de41048854679dacdf11b9.c4e283128865c4bdf9f0bb0216dcf0a7 to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed5e480b1fc9e79fa3d1c13f133eb34b/cf/de232a6213de41048854679dacdf11b9.c4e283128865c4bdf9f0bb0216dcf0a7 2023-09-21 08:02:47,131 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4e283128865c4bdf9f0bb0216dcf0a7/recovered.edits/8.seqid to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4e283128865c4bdf9f0bb0216dcf0a7/recovered.edits/8.seqid 2023-09-21 08:02:47,131 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c4e283128865c4bdf9f0bb0216dcf0a7 2023-09-21 08:02:47,132 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/50bfdaf8f6036db28700eb9f823f8ee3/recovered.edits/8.seqid to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/50bfdaf8f6036db28700eb9f823f8ee3/recovered.edits/8.seqid 2023-09-21 08:02:47,132 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/50bfdaf8f6036db28700eb9f823f8ee3 2023-09-21 08:02:47,133 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed5e480b1fc9e79fa3d1c13f133eb34b/recovered.edits/12.seqid to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed5e480b1fc9e79fa3d1c13f133eb34b/recovered.edits/12.seqid 2023-09-21 08:02:47,133 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ed5e480b1fc9e79fa3d1c13f133eb34b 2023-09-21 08:02:47,133 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-21 08:02:47,135 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:47,137 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-21 08:02:47,139 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-21 08:02:47,140 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:47,140 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-21 08:02:47,140 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353365.ed5e480b1fc9e79fa3d1c13f133eb34b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695283367140"}]},"ts":"9223372036854775807"} 2023-09-21 08:02:47,142 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-21 08:02:47,142 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ed5e480b1fc9e79fa3d1c13f133eb34b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695283353365.ed5e480b1fc9e79fa3d1c13f133eb34b.', STARTKEY => '', ENDKEY => ''}] 2023-09-21 08:02:47,142 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-21 08:02:47,142 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695283367142"}]},"ts":"9223372036854775807"} 2023-09-21 08:02:47,144 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-21 08:02:47,145 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:47,147 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 34 msec 2023-09-21 08:02:47,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-21 08:02:47,225 INFO [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-21 08:02:47,226 INFO [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:47,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:47,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:47,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-21 08:02:47,230 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695283367230"}]},"ts":"1695283367230"} 2023-09-21 08:02:47,232 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-21 08:02:47,233 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-21 08:02:47,234 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2ae81a6c20365c6f7479d10ef3553215, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=edf7ebbff8d0ead21dca48b0cf162774, UNASSIGN}] 2023-09-21 08:02:47,236 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2ae81a6c20365c6f7479d10ef3553215, UNASSIGN 2023-09-21 08:02:47,236 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=edf7ebbff8d0ead21dca48b0cf162774, UNASSIGN 2023-09-21 08:02:47,237 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=edf7ebbff8d0ead21dca48b0cf162774, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:47,237 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=2ae81a6c20365c6f7479d10ef3553215, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:47,237 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695283352202.edf7ebbff8d0ead21dca48b0cf162774.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695283367236"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695283367236"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695283367236"}]},"ts":"1695283367236"} 2023-09-21 08:02:47,237 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695283352202.2ae81a6c20365c6f7479d10ef3553215.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695283367236"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695283367236"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695283367236"}]},"ts":"1695283367236"} 2023-09-21 08:02:47,238 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure edf7ebbff8d0ead21dca48b0cf162774, server=jenkins-hbase4.apache.org,43299,1695283279840}] 2023-09-21 08:02:47,239 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure 2ae81a6c20365c6f7479d10ef3553215, server=jenkins-hbase4.apache.org,40677,1695283279880}] 2023-09-21 08:02:47,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-21 08:02:47,390 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2ae81a6c20365c6f7479d10ef3553215 2023-09-21 08:02:47,390 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close edf7ebbff8d0ead21dca48b0cf162774 2023-09-21 08:02:47,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2ae81a6c20365c6f7479d10ef3553215, disabling compactions & flushes 2023-09-21 08:02:47,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing edf7ebbff8d0ead21dca48b0cf162774, disabling compactions & flushes 2023-09-21 08:02:47,391 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695283352202.2ae81a6c20365c6f7479d10ef3553215. 2023-09-21 08:02:47,391 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695283352202.edf7ebbff8d0ead21dca48b0cf162774. 2023-09-21 08:02:47,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695283352202.2ae81a6c20365c6f7479d10ef3553215. 2023-09-21 08:02:47,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695283352202.edf7ebbff8d0ead21dca48b0cf162774. 2023-09-21 08:02:47,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695283352202.2ae81a6c20365c6f7479d10ef3553215. after waiting 0 ms 2023-09-21 08:02:47,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695283352202.edf7ebbff8d0ead21dca48b0cf162774. after waiting 0 ms 2023-09-21 08:02:47,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695283352202.edf7ebbff8d0ead21dca48b0cf162774. 2023-09-21 08:02:47,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695283352202.2ae81a6c20365c6f7479d10ef3553215. 2023-09-21 08:02:47,400 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion/edf7ebbff8d0ead21dca48b0cf162774/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-21 08:02:47,401 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithMergeRegion/2ae81a6c20365c6f7479d10ef3553215/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-21 08:02:47,401 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 08:02:47,402 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695283352202.edf7ebbff8d0ead21dca48b0cf162774. 2023-09-21 08:02:47,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for edf7ebbff8d0ead21dca48b0cf162774: 2023-09-21 08:02:47,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 08:02:47,403 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695283352202.2ae81a6c20365c6f7479d10ef3553215. 2023-09-21 08:02:47,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2ae81a6c20365c6f7479d10ef3553215: 2023-09-21 08:02:47,404 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed edf7ebbff8d0ead21dca48b0cf162774 2023-09-21 08:02:47,404 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=edf7ebbff8d0ead21dca48b0cf162774, regionState=CLOSED 2023-09-21 08:02:47,405 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695283352202.edf7ebbff8d0ead21dca48b0cf162774.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695283367404"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695283367404"}]},"ts":"1695283367404"} 2023-09-21 08:02:47,405 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2ae81a6c20365c6f7479d10ef3553215 2023-09-21 08:02:47,405 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=2ae81a6c20365c6f7479d10ef3553215, regionState=CLOSED 2023-09-21 08:02:47,405 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695283352202.2ae81a6c20365c6f7479d10ef3553215.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695283367405"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695283367405"}]},"ts":"1695283367405"} 2023-09-21 08:02:47,407 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=86 2023-09-21 08:02:47,407 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure edf7ebbff8d0ead21dca48b0cf162774, server=jenkins-hbase4.apache.org,43299,1695283279840 in 168 msec 2023-09-21 08:02:47,408 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=85 2023-09-21 08:02:47,408 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=edf7ebbff8d0ead21dca48b0cf162774, UNASSIGN in 173 msec 2023-09-21 08:02:47,408 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure 2ae81a6c20365c6f7479d10ef3553215, server=jenkins-hbase4.apache.org,40677,1695283279880 in 167 msec 2023-09-21 08:02:47,409 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=84 2023-09-21 08:02:47,410 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2ae81a6c20365c6f7479d10ef3553215, UNASSIGN in 174 msec 2023-09-21 08:02:47,410 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695283367410"}]},"ts":"1695283367410"} 2023-09-21 08:02:47,411 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-21 08:02:47,414 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-21 08:02:47,415 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 188 msec 2023-09-21 08:02:47,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-21 08:02:47,533 INFO [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-21 08:02:47,534 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:47,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:47,537 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:47,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:47,537 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:47,539 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43299] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:47,542 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2ae81a6c20365c6f7479d10ef3553215 2023-09-21 08:02:47,542 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/edf7ebbff8d0ead21dca48b0cf162774 2023-09-21 08:02:47,542 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:47,542 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:47,542 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:47,542 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:47,542 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-21 08:02:47,543 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-21 08:02:47,543 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-21 08:02:47,543 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-21 08:02:47,544 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:47,544 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:02:47,544 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:47,544 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:02:47,544 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:47,544 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:02:47,544 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2ae81a6c20365c6f7479d10ef3553215/cf, FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2ae81a6c20365c6f7479d10ef3553215/recovered.edits] 2023-09-21 08:02:47,544 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:47,544 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:02:47,544 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/edf7ebbff8d0ead21dca48b0cf162774/cf, FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/edf7ebbff8d0ead21dca48b0cf162774/recovered.edits] 2023-09-21 08:02:47,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-21 08:02:47,548 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2ae81a6c20365c6f7479d10ef3553215/cf/c679f68aa1fe4978b9b946249b5056e2 to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/2ae81a6c20365c6f7479d10ef3553215/cf/c679f68aa1fe4978b9b946249b5056e2 2023-09-21 08:02:47,548 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/edf7ebbff8d0ead21dca48b0cf162774/cf/b319b9bf6e124b1694488022babe9ca3 to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/edf7ebbff8d0ead21dca48b0cf162774/cf/b319b9bf6e124b1694488022babe9ca3 2023-09-21 08:02:47,551 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2ae81a6c20365c6f7479d10ef3553215/recovered.edits/9.seqid to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/2ae81a6c20365c6f7479d10ef3553215/recovered.edits/9.seqid 2023-09-21 08:02:47,551 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/edf7ebbff8d0ead21dca48b0cf162774/recovered.edits/9.seqid to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/edf7ebbff8d0ead21dca48b0cf162774/recovered.edits/9.seqid 2023-09-21 08:02:47,551 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2ae81a6c20365c6f7479d10ef3553215 2023-09-21 08:02:47,552 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/edf7ebbff8d0ead21dca48b0cf162774 2023-09-21 08:02:47,552 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-21 08:02:47,552 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-21 08:02:47,553 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-21 08:02:47,555 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023092163e1c3bab691423396a254350031f91e to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023092163e1c3bab691423396a254350031f91e 2023-09-21 08:02:47,557 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230921c97e8aa4a6054250979535aae643f2ce to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230921c97e8aa4a6054250979535aae643f2ce 2023-09-21 08:02:47,557 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-21 08:02:47,559 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:47,561 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-21 08:02:47,563 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-21 08:02:47,564 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:47,564 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-21 08:02:47,564 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695283352202.2ae81a6c20365c6f7479d10ef3553215.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695283367564"}]},"ts":"9223372036854775807"} 2023-09-21 08:02:47,564 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695283352202.edf7ebbff8d0ead21dca48b0cf162774.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695283367564"}]},"ts":"9223372036854775807"} 2023-09-21 08:02:47,565 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-21 08:02:47,566 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2ae81a6c20365c6f7479d10ef3553215, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695283352202.2ae81a6c20365c6f7479d10ef3553215.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => edf7ebbff8d0ead21dca48b0cf162774, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695283352202.edf7ebbff8d0ead21dca48b0cf162774.', STARTKEY => '1', ENDKEY => ''}] 2023-09-21 08:02:47,566 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-21 08:02:47,566 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695283367566"}]},"ts":"9223372036854775807"} 2023-09-21 08:02:47,567 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-21 08:02:47,570 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:47,571 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 36 msec 2023-09-21 08:02:47,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-21 08:02:47,646 INFO [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-21 08:02:47,655 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-21 08:02:47,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:47,658 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-21 08:02:47,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-21 08:02:47,661 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-21 08:02:47,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-21 08:02:47,687 INFO [Listener at jenkins-hbase4.apache.org/40119] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=757 (was 747) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-501182444_17 at /127.0.0.1:34098 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1104155582) connection to jenkins-hbase4.apache.org/172.31.14.131:41265 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x47a0dadd-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-266891648_1 at /127.0.0.1:39174 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-501182444_17 at /127.0.0.1:58776 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x47a0dadd-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-266891648_1 at /127.0.0.1:58752 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x47a0dadd-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x47a0dadd-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x47a0dadd-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x47a0dadd-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3954 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) - Thread LEAK? -, OpenFileDescriptor=911 (was 905) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=145 (was 121) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=2271 (was 2382) 2023-09-21 08:02:47,687 WARN [Listener at jenkins-hbase4.apache.org/40119] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-09-21 08:02:47,710 INFO [Listener at jenkins-hbase4.apache.org/40119] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=757, OpenFileDescriptor=911, MaxFileDescriptor=60000, SystemLoadAverage=145, ProcessCount=168, AvailableMemoryMB=2270 2023-09-21 08:02:47,710 WARN [Listener at jenkins-hbase4.apache.org/40119] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-09-21 08:02:47,712 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-21 08:02:47,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-21 08:02:47,715 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-21 08:02:47,715 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-21 08:02:47,716 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-21 08:02:47,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-21 08:02:47,719 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testEmptyExportFileSystemState/091b765069f12e171daf3f3abb915946 2023-09-21 08:02:47,719 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testEmptyExportFileSystemState/3f1c30ffcd7c1ae1776a49bd35141148 2023-09-21 08:02:47,719 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testEmptyExportFileSystemState/091b765069f12e171daf3f3abb915946 empty. 2023-09-21 08:02:47,719 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testEmptyExportFileSystemState/3f1c30ffcd7c1ae1776a49bd35141148 empty. 2023-09-21 08:02:47,720 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testEmptyExportFileSystemState/3f1c30ffcd7c1ae1776a49bd35141148 2023-09-21 08:02:47,720 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testEmptyExportFileSystemState/091b765069f12e171daf3f3abb915946 2023-09-21 08:02:47,720 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-21 08:02:47,729 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-21 08:02:47,730 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3f1c30ffcd7c1ae1776a49bd35141148, NAME => 'testtb-testEmptyExportFileSystemState,,1695283367711.3f1c30ffcd7c1ae1776a49bd35141148.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp 2023-09-21 08:02:47,730 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 091b765069f12e171daf3f3abb915946, NAME => 'testtb-testEmptyExportFileSystemState,1,1695283367711.091b765069f12e171daf3f3abb915946.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp 2023-09-21 08:02:47,737 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695283367711.3f1c30ffcd7c1ae1776a49bd35141148.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 08:02:47,738 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695283367711.091b765069f12e171daf3f3abb915946.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 08:02:47,738 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 3f1c30ffcd7c1ae1776a49bd35141148, disabling compactions & flushes 2023-09-21 08:02:47,738 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 091b765069f12e171daf3f3abb915946, disabling compactions & flushes 2023-09-21 08:02:47,738 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695283367711.3f1c30ffcd7c1ae1776a49bd35141148. 2023-09-21 08:02:47,738 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695283367711.091b765069f12e171daf3f3abb915946. 2023-09-21 08:02:47,738 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695283367711.091b765069f12e171daf3f3abb915946. 2023-09-21 08:02:47,738 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695283367711.3f1c30ffcd7c1ae1776a49bd35141148. 2023-09-21 08:02:47,738 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695283367711.091b765069f12e171daf3f3abb915946. after waiting 0 ms 2023-09-21 08:02:47,738 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695283367711.091b765069f12e171daf3f3abb915946. 2023-09-21 08:02:47,738 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695283367711.3f1c30ffcd7c1ae1776a49bd35141148. after waiting 0 ms 2023-09-21 08:02:47,738 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695283367711.3f1c30ffcd7c1ae1776a49bd35141148. 2023-09-21 08:02:47,738 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695283367711.091b765069f12e171daf3f3abb915946. 2023-09-21 08:02:47,738 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695283367711.3f1c30ffcd7c1ae1776a49bd35141148. 2023-09-21 08:02:47,738 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 3f1c30ffcd7c1ae1776a49bd35141148: 2023-09-21 08:02:47,738 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 091b765069f12e171daf3f3abb915946: 2023-09-21 08:02:47,740 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-21 08:02:47,741 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695283367711.3f1c30ffcd7c1ae1776a49bd35141148.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695283367741"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695283367741"}]},"ts":"1695283367741"} 2023-09-21 08:02:47,741 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695283367711.091b765069f12e171daf3f3abb915946.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695283367741"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695283367741"}]},"ts":"1695283367741"} 2023-09-21 08:02:47,743 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-21 08:02:47,744 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-21 08:02:47,744 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695283367744"}]},"ts":"1695283367744"} 2023-09-21 08:02:47,745 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-21 08:02:47,748 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-21 08:02:47,749 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-21 08:02:47,749 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-21 08:02:47,749 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-21 08:02:47,749 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-21 08:02:47,750 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3f1c30ffcd7c1ae1776a49bd35141148, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=091b765069f12e171daf3f3abb915946, ASSIGN}] 2023-09-21 08:02:47,752 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=091b765069f12e171daf3f3abb915946, ASSIGN 2023-09-21 08:02:47,752 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3f1c30ffcd7c1ae1776a49bd35141148, ASSIGN 2023-09-21 08:02:47,753 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=091b765069f12e171daf3f3abb915946, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43299,1695283279840; forceNewPlan=false, retain=false 2023-09-21 08:02:47,753 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3f1c30ffcd7c1ae1776a49bd35141148, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40677,1695283279880; forceNewPlan=false, retain=false 2023-09-21 08:02:47,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-21 08:02:47,903 INFO [jenkins-hbase4:34581] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-21 08:02:47,906 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=3f1c30ffcd7c1ae1776a49bd35141148, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:47,906 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=091b765069f12e171daf3f3abb915946, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:47,906 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695283367711.3f1c30ffcd7c1ae1776a49bd35141148.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695283367906"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695283367906"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695283367906"}]},"ts":"1695283367906"} 2023-09-21 08:02:47,906 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695283367711.091b765069f12e171daf3f3abb915946.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695283367906"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695283367906"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695283367906"}]},"ts":"1695283367906"} 2023-09-21 08:02:47,908 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 3f1c30ffcd7c1ae1776a49bd35141148, server=jenkins-hbase4.apache.org,40677,1695283279880}] 2023-09-21 08:02:47,909 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 091b765069f12e171daf3f3abb915946, server=jenkins-hbase4.apache.org,43299,1695283279840}] 2023-09-21 08:02:48,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-21 08:02:48,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1695283367711.091b765069f12e171daf3f3abb915946. 2023-09-21 08:02:48,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 091b765069f12e171daf3f3abb915946, NAME => 'testtb-testEmptyExportFileSystemState,1,1695283367711.091b765069f12e171daf3f3abb915946.', STARTKEY => '1', ENDKEY => ''} 2023-09-21 08:02:48,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1695283367711.091b765069f12e171daf3f3abb915946. service=AccessControlService 2023-09-21 08:02:48,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1695283367711.3f1c30ffcd7c1ae1776a49bd35141148. 2023-09-21 08:02:48,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 08:02:48,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3f1c30ffcd7c1ae1776a49bd35141148, NAME => 'testtb-testEmptyExportFileSystemState,,1695283367711.3f1c30ffcd7c1ae1776a49bd35141148.', STARTKEY => '', ENDKEY => '1'} 2023-09-21 08:02:48,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 091b765069f12e171daf3f3abb915946 2023-09-21 08:02:48,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695283367711.091b765069f12e171daf3f3abb915946.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 08:02:48,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 091b765069f12e171daf3f3abb915946 2023-09-21 08:02:48,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1695283367711.3f1c30ffcd7c1ae1776a49bd35141148. service=AccessControlService 2023-09-21 08:02:48,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 091b765069f12e171daf3f3abb915946 2023-09-21 08:02:48,064 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 08:02:48,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 3f1c30ffcd7c1ae1776a49bd35141148 2023-09-21 08:02:48,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695283367711.3f1c30ffcd7c1ae1776a49bd35141148.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 08:02:48,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3f1c30ffcd7c1ae1776a49bd35141148 2023-09-21 08:02:48,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3f1c30ffcd7c1ae1776a49bd35141148 2023-09-21 08:02:48,065 INFO [StoreOpener-091b765069f12e171daf3f3abb915946-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 091b765069f12e171daf3f3abb915946 2023-09-21 08:02:48,065 INFO [StoreOpener-3f1c30ffcd7c1ae1776a49bd35141148-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3f1c30ffcd7c1ae1776a49bd35141148 2023-09-21 08:02:48,066 DEBUG [StoreOpener-091b765069f12e171daf3f3abb915946-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testEmptyExportFileSystemState/091b765069f12e171daf3f3abb915946/cf 2023-09-21 08:02:48,066 DEBUG [StoreOpener-091b765069f12e171daf3f3abb915946-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testEmptyExportFileSystemState/091b765069f12e171daf3f3abb915946/cf 2023-09-21 08:02:48,066 DEBUG [StoreOpener-3f1c30ffcd7c1ae1776a49bd35141148-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testEmptyExportFileSystemState/3f1c30ffcd7c1ae1776a49bd35141148/cf 2023-09-21 08:02:48,066 DEBUG [StoreOpener-3f1c30ffcd7c1ae1776a49bd35141148-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testEmptyExportFileSystemState/3f1c30ffcd7c1ae1776a49bd35141148/cf 2023-09-21 08:02:48,067 INFO [StoreOpener-3f1c30ffcd7c1ae1776a49bd35141148-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f1c30ffcd7c1ae1776a49bd35141148 columnFamilyName cf 2023-09-21 08:02:48,067 INFO [StoreOpener-091b765069f12e171daf3f3abb915946-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 091b765069f12e171daf3f3abb915946 columnFamilyName cf 2023-09-21 08:02:48,068 INFO [StoreOpener-3f1c30ffcd7c1ae1776a49bd35141148-1] regionserver.HStore(310): Store=3f1c30ffcd7c1ae1776a49bd35141148/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 08:02:48,068 INFO [StoreOpener-091b765069f12e171daf3f3abb915946-1] regionserver.HStore(310): Store=091b765069f12e171daf3f3abb915946/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 08:02:48,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testEmptyExportFileSystemState/3f1c30ffcd7c1ae1776a49bd35141148 2023-09-21 08:02:48,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testEmptyExportFileSystemState/091b765069f12e171daf3f3abb915946 2023-09-21 08:02:48,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testEmptyExportFileSystemState/3f1c30ffcd7c1ae1776a49bd35141148 2023-09-21 08:02:48,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testEmptyExportFileSystemState/091b765069f12e171daf3f3abb915946 2023-09-21 08:02:48,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 091b765069f12e171daf3f3abb915946 2023-09-21 08:02:48,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3f1c30ffcd7c1ae1776a49bd35141148 2023-09-21 08:02:48,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testEmptyExportFileSystemState/091b765069f12e171daf3f3abb915946/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-21 08:02:48,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testEmptyExportFileSystemState/3f1c30ffcd7c1ae1776a49bd35141148/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-21 08:02:48,074 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 091b765069f12e171daf3f3abb915946; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60452354, jitterRate=-0.09918972849845886}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-21 08:02:48,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 091b765069f12e171daf3f3abb915946: 2023-09-21 08:02:48,075 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3f1c30ffcd7c1ae1776a49bd35141148; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64537206, jitterRate=-0.038320690393447876}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-21 08:02:48,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3f1c30ffcd7c1ae1776a49bd35141148: 2023-09-21 08:02:48,075 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1695283367711.091b765069f12e171daf3f3abb915946., pid=94, masterSystemTime=1695283368060 2023-09-21 08:02:48,075 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1695283367711.3f1c30ffcd7c1ae1776a49bd35141148., pid=93, masterSystemTime=1695283368060 2023-09-21 08:02:48,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1695283367711.091b765069f12e171daf3f3abb915946. 2023-09-21 08:02:48,077 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1695283367711.091b765069f12e171daf3f3abb915946. 2023-09-21 08:02:48,077 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=091b765069f12e171daf3f3abb915946, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:48,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1695283367711.3f1c30ffcd7c1ae1776a49bd35141148. 2023-09-21 08:02:48,077 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1695283367711.091b765069f12e171daf3f3abb915946.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695283368077"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695283368077"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695283368077"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695283368077"}]},"ts":"1695283368077"} 2023-09-21 08:02:48,077 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1695283367711.3f1c30ffcd7c1ae1776a49bd35141148. 2023-09-21 08:02:48,078 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=3f1c30ffcd7c1ae1776a49bd35141148, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:48,078 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1695283367711.3f1c30ffcd7c1ae1776a49bd35141148.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695283368078"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695283368078"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695283368078"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695283368078"}]},"ts":"1695283368078"} 2023-09-21 08:02:48,080 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=92 2023-09-21 08:02:48,080 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 091b765069f12e171daf3f3abb915946, server=jenkins-hbase4.apache.org,43299,1695283279840 in 170 msec 2023-09-21 08:02:48,081 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=91 2023-09-21 08:02:48,081 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 3f1c30ffcd7c1ae1776a49bd35141148, server=jenkins-hbase4.apache.org,40677,1695283279880 in 171 msec 2023-09-21 08:02:48,081 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=091b765069f12e171daf3f3abb915946, ASSIGN in 330 msec 2023-09-21 08:02:48,082 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=91, resume processing ppid=90 2023-09-21 08:02:48,083 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3f1c30ffcd7c1ae1776a49bd35141148, ASSIGN in 331 msec 2023-09-21 08:02:48,083 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-21 08:02:48,083 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695283368083"}]},"ts":"1695283368083"} 2023-09-21 08:02:48,084 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-21 08:02:48,087 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-21 08:02:48,087 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-21 08:02:48,088 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43299] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-21 08:02:48,091 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:02:48,091 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:02:48,091 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:02:48,091 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:02:48,093 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-21 08:02:48,093 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-21 08:02:48,093 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-21 08:02:48,093 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-21 08:02:48,094 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 381 msec 2023-09-21 08:02:48,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-21 08:02:48,320 INFO [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-21 08:02:48,323 DEBUG [Listener at jenkins-hbase4.apache.org/40119] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-21 08:02:48,323 DEBUG [Listener at jenkins-hbase4.apache.org/40119] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695283367711.3f1c30ffcd7c1ae1776a49bd35141148. 2023-09-21 08:02:48,325 INFO [Listener at jenkins-hbase4.apache.org/40119] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-21 08:02:48,335 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-21 08:02:48,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695283368336 (current time:1695283368336). 2023-09-21 08:02:48,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-21 08:02:48,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(139): Connect 0x3864d348 to 127.0.0.1:58708 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 08:02:48,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@fd2bd2f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 08:02:48,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:02:48,349 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48822, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:02:48,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3864d348 to 127.0.0.1:58708 2023-09-21 08:02:48,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 08:02:48,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(139): Connect 0x45753fd7 to 127.0.0.1:58708 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 08:02:48,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b154aa2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 08:02:48,360 DEBUG [hconnection-0x4134bf2a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:02:48,363 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48824, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:02:48,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:02:48,369 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37626, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:02:48,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x45753fd7 to 127.0.0.1:58708 2023-09-21 08:02:48,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 08:02:48,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-21 08:02:48,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-21 08:02:48,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-21 08:02:48,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-21 08:02:48,374 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-21 08:02:48,375 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695283968375 2023-09-21 08:02:48,375 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-21 08:02:48,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-21 08:02:48,376 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-21 08:02:48,377 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-21 08:02:48,376 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-21 08:02:48,377 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-21 08:02:48,378 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-09-21 08:02:48,381 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-21 08:02:48,381 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695283968381 2023-09-21 08:02:48,390 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,390 INFO [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-21 08:02:48,391 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:02:48,392 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-21 08:02:48,392 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-21 08:02:48,393 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,393 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,399 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:48,399 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:48,399 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:48,399 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:48,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:48,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:48,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:48,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:48,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:48,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:48,399 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:48,399 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:48,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,400 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:48,400 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-21 08:02:48,400 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,400 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,400 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-21 08:02:48,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-21 08:02:48,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-21 08:02:48,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,400 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-21 08:02:48,400 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-21 08:02:48,401 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-21 08:02:48,401 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,401 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,401 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,401 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-21 08:02:48,401 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-21 08:02:48,401 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:02:48,401 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-21 08:02:48,401 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:02:48,403 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:02:48,415 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-21 08:02:48,415 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-21 08:02:48,415 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-21 08:02:48,415 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-21 08:02:48,415 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-21 08:02:48,415 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36469,1695283279785' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-21 08:02:48,415 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-21 08:02:48,415 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43299,1695283279840' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-21 08:02:48,415 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40677,1695283279880' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-21 08:02:48,417 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,418 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:48,418 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:48,418 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,418 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 08:02:48,418 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:02:48,418 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,418 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 08:02:48,418 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:48,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:02:48,418 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,419 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 08:02:48,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:02:48,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:02:48,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:48,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:48,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:48,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:02:48,421 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40677,1695283279880' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-21 08:02:48,421 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75c2b29f[Count = 1] remaining members to acquire global barrier 2023-09-21 08:02:48,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:48,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:02:48,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:02:48,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:02:48,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:02:48,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:48,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:48,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:48,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:02:48,424 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43299,1695283279840' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-21 08:02:48,424 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75c2b29f[Count = 0] remaining members to acquire global barrier 2023-09-21 08:02:48,424 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-21 08:02:48,424 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,425 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,425 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,425 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,425 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:48,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,425 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-21 08:02:48,425 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-21 08:02:48,425 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-21 08:02:48,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,425 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:48,426 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-21 08:02:48,425 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36469,1695283279785' in zk 2023-09-21 08:02:48,426 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 08:02:48,426 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 08:02:48,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,426 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695283367711.091b765069f12e171daf3f3abb915946. 2023-09-21 08:02:48,426 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-21 08:02:48,426 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695283367711.091b765069f12e171daf3f3abb915946. started... 2023-09-21 08:02:48,426 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 08:02:48,426 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 08:02:48,428 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695283367711.3f1c30ffcd7c1ae1776a49bd35141148. 2023-09-21 08:02:48,428 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 091b765069f12e171daf3f3abb915946: 2023-09-21 08:02:48,428 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695283367711.3f1c30ffcd7c1ae1776a49bd35141148. started... 2023-09-21 08:02:48,428 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3f1c30ffcd7c1ae1776a49bd35141148: 2023-09-21 08:02:48,428 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695283367711.091b765069f12e171daf3f3abb915946.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,428 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 08:02:48,428 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695283367711.3f1c30ffcd7c1ae1776a49bd35141148.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,428 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-21 08:02:48,428 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 08:02:48,428 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-21 08:02:48,430 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-21 08:02:48,430 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:02:48,430 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-21 08:02:48,438 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695283367711.091b765069f12e171daf3f3abb915946. completed. 2023-09-21 08:02:48,438 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695283367711.091b765069f12e171daf3f3abb915946. 2023-09-21 08:02:48,439 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 08:02:48,439 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 08:02:48,439 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:48,439 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-21 08:02:48,439 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43299,1695283279840' in zk 2023-09-21 08:02:48,439 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695283367711.3f1c30ffcd7c1ae1776a49bd35141148. completed. 2023-09-21 08:02:48,439 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695283367711.3f1c30ffcd7c1ae1776a49bd35141148. 2023-09-21 08:02:48,439 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 08:02:48,439 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 08:02:48,440 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:48,440 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-21 08:02:48,440 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40677,1695283279880' in zk 2023-09-21 08:02:48,441 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:48,441 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-21 08:02:48,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:48,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:02:48,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:02:48,441 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:02:48,441 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-21 08:02:48,443 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-21 08:02:48,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:02:48,443 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:02:48,443 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:48,443 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-21 08:02:48,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:02:48,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:48,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:48,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:48,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:02:48,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:48,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:48,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:48,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43299,1695283279840': 2023-09-21 08:02:48,447 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43299,1695283279840' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-21 08:02:48,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:48,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:02:48,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:02:48,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:02:48,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:02:48,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:48,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:48,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:48,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:02:48,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:48,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:48,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:48,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40677,1695283279880': 2023-09-21 08:02:48,450 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40677,1695283279880' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-21 08:02:48,450 INFO [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-21 08:02:48,450 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-21 08:02:48,450 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-21 08:02:48,450 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,450 INFO [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-21 08:02:48,452 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,452 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:02:48,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:02:48,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,452 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:02:48,452 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,452 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,453 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:02:48,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:02:48,453 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:02:48,454 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:48,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:02:48,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:02:48,454 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:48,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:02:48,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:02:48,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:02:48,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:02:48,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:02:48,454 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:48,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:48,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:48,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:48,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:02:48,456 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:48,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,456 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:48,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:48,457 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:48,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:48,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:48,460 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:48,460 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:48,460 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,460 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:48,460 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:48,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:48,460 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:02:48,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:48,460 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:48,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:48,460 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:02:48,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:48,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:48,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:48,460 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:02:48,460 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,460 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:48,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:02:48,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:02:48,460 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:02:48,462 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,462 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-21 08:02:48,462 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:48,462 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:02:48,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:02:48,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:02:48,462 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:02:48,462 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-21 08:02:48,463 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:48,463 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:48,463 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,463 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,463 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-21 08:02:48,470 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,471 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,477 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 08:02:48,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-21 08:02:48,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-21 08:02:48,478 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-21 08:02:48,494 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,495 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-21 08:02:48,495 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,495 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,495 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695283368375Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695283368470 (+95 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695283368470Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1695283368470Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1695283368473 (+3 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695283368489 (+16 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695283368495 (+6 ms) 2023-09-21 08:02:48,499 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-21 08:02:48,500 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 123 msec 2023-09-21 08:02:48,679 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 08:02:48,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-21 08:02:48,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-21 08:02:48,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40677] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1695283367711.3f1c30ffcd7c1ae1776a49bd35141148. with WAL disabled. Data may be lost in the event of a crash. 2023-09-21 08:02:48,683 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1695283367711.091b765069f12e171daf3f3abb915946. with WAL disabled. Data may be lost in the event of a crash. 2023-09-21 08:02:48,686 DEBUG [Listener at jenkins-hbase4.apache.org/40119] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-21 08:02:48,686 DEBUG [Listener at jenkins-hbase4.apache.org/40119] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695283367711.3f1c30ffcd7c1ae1776a49bd35141148. 2023-09-21 08:02:48,686 INFO [Listener at jenkins-hbase4.apache.org/40119] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-21 08:02:48,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-21 08:02:48,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695283368695 (current time:1695283368695). 2023-09-21 08:02:48,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-21 08:02:48,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(139): Connect 0x4333b6a7 to 127.0.0.1:58708 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 08:02:48,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@271a9c04, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 08:02:48,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:02:48,706 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48830, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:02:48,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4333b6a7 to 127.0.0.1:58708 2023-09-21 08:02:48,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 08:02:48,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(139): Connect 0x73152e10 to 127.0.0.1:58708 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 08:02:48,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d4d385b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 08:02:48,716 DEBUG [hconnection-0x5ec47b4a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:02:48,717 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48832, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:02:48,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:02:48,723 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37642, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:02:48,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x73152e10 to 127.0.0.1:58708 2023-09-21 08:02:48,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 08:02:48,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-21 08:02:48,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-21 08:02:48,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-21 08:02:48,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-21 08:02:48,728 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-21 08:02:48,729 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695283968729 2023-09-21 08:02:48,729 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-21 08:02:48,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-21 08:02:48,731 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-21 08:02:48,731 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-21 08:02:48,731 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-21 08:02:48,732 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-21 08:02:48,733 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-09-21 08:02:48,734 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-21 08:02:48,734 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695283968734 2023-09-21 08:02:48,742 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,742 INFO [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-21 08:02:48,742 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:02:48,744 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-21 08:02:48,744 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-21 08:02:48,744 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,744 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,746 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:48,746 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:48,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:48,746 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:48,746 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:48,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:48,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:48,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:48,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:48,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:48,746 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:48,746 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:48,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,746 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:48,746 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-21 08:02:48,746 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,747 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,747 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-21 08:02:48,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-21 08:02:48,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-21 08:02:48,747 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-21 08:02:48,747 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-21 08:02:48,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,747 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-21 08:02:48,747 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,747 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,747 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-21 08:02:48,748 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-21 08:02:48,748 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,748 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:02:48,748 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-21 08:02:48,749 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-21 08:02:48,749 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-21 08:02:48,749 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43299,1695283279840' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-21 08:02:48,748 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:02:48,749 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:02:48,750 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-21 08:02:48,753 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-21 08:02:48,753 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36469,1695283279785' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-21 08:02:48,753 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-21 08:02:48,753 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-21 08:02:48,753 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40677,1695283279880' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-21 08:02:48,754 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,754 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:48,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:48,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:02:48,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:02:48,755 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:48,755 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,755 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,755 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 08:02:48,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:02:48,755 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,755 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,755 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 08:02:48,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:02:48,756 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,756 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 08:02:48,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:48,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:48,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:48,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:02:48,757 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43299,1695283279840' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-21 08:02:48,757 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a05b148[Count = 1] remaining members to acquire global barrier 2023-09-21 08:02:48,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:48,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:02:48,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:02:48,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:02:48,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:02:48,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:48,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:48,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:48,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:02:48,759 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40677,1695283279880' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-21 08:02:48,759 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a05b148[Count = 0] remaining members to acquire global barrier 2023-09-21 08:02:48,759 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-21 08:02:48,759 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,763 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,763 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,763 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,763 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:48,763 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-21 08:02:48,763 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-21 08:02:48,763 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-21 08:02:48,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,763 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36469,1695283279785' in zk 2023-09-21 08:02:48,763 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 08:02:48,764 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 08:02:48,764 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:48,764 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-21 08:02:48,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,764 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-21 08:02:48,764 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695283367711.3f1c30ffcd7c1ae1776a49bd35141148. 2023-09-21 08:02:48,764 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 08:02:48,764 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695283367711.3f1c30ffcd7c1ae1776a49bd35141148. started... 2023-09-21 08:02:48,764 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 08:02:48,764 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695283367711.091b765069f12e171daf3f3abb915946. 2023-09-21 08:02:48,764 INFO [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3f1c30ffcd7c1ae1776a49bd35141148 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-21 08:02:48,764 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695283367711.091b765069f12e171daf3f3abb915946. started... 2023-09-21 08:02:48,764 INFO [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 091b765069f12e171daf3f3abb915946 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-21 08:02:48,765 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-21 08:02:48,765 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:02:48,765 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-21 08:02:48,781 INFO [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230921c94bfc18e7f14efcbbde101dca9a2a80 to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230921c94bfc18e7f14efcbbde101dca9a2a80 2023-09-21 08:02:48,782 INFO [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309212e5cdd3b4a454bb5b70c170ed5da6d08 to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309212e5cdd3b4a454bb5b70c170ed5da6d08 2023-09-21 08:02:48,788 INFO [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testEmptyExportFileSystemState/3f1c30ffcd7c1ae1776a49bd35141148/.tmp/cf/f974b643a7a64934aea78a4131bbd38a 2023-09-21 08:02:48,789 INFO [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testEmptyExportFileSystemState/091b765069f12e171daf3f3abb915946/.tmp/cf/70e7bccd46614742b8031d97abf32221 2023-09-21 08:02:48,794 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testEmptyExportFileSystemState/3f1c30ffcd7c1ae1776a49bd35141148/.tmp/cf/f974b643a7a64934aea78a4131bbd38a as hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testEmptyExportFileSystemState/3f1c30ffcd7c1ae1776a49bd35141148/cf/f974b643a7a64934aea78a4131bbd38a 2023-09-21 08:02:48,794 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testEmptyExportFileSystemState/091b765069f12e171daf3f3abb915946/.tmp/cf/70e7bccd46614742b8031d97abf32221 as hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testEmptyExportFileSystemState/091b765069f12e171daf3f3abb915946/cf/70e7bccd46614742b8031d97abf32221 2023-09-21 08:02:48,799 INFO [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testEmptyExportFileSystemState/091b765069f12e171daf3f3abb915946/cf/70e7bccd46614742b8031d97abf32221, entries=48, sequenceid=6, filesize=13.2 K 2023-09-21 08:02:48,799 INFO [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testEmptyExportFileSystemState/3f1c30ffcd7c1ae1776a49bd35141148/cf/f974b643a7a64934aea78a4131bbd38a, entries=2, sequenceid=6, filesize=5.2 K 2023-09-21 08:02:48,799 INFO [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 091b765069f12e171daf3f3abb915946 in 35ms, sequenceid=6, compaction requested=false 2023-09-21 08:02:48,800 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-21 08:02:48,800 INFO [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 3f1c30ffcd7c1ae1776a49bd35141148 in 36ms, sequenceid=6, compaction requested=false 2023-09-21 08:02:48,800 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-21 08:02:48,803 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 091b765069f12e171daf3f3abb915946: 2023-09-21 08:02:48,803 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3f1c30ffcd7c1ae1776a49bd35141148: 2023-09-21 08:02:48,803 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695283367711.091b765069f12e171daf3f3abb915946.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,803 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695283367711.3f1c30ffcd7c1ae1776a49bd35141148.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,803 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 08:02:48,804 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 08:02:48,804 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testEmptyExportFileSystemState/091b765069f12e171daf3f3abb915946/cf/70e7bccd46614742b8031d97abf32221] hfiles 2023-09-21 08:02:48,804 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testEmptyExportFileSystemState/3f1c30ffcd7c1ae1776a49bd35141148/cf/f974b643a7a64934aea78a4131bbd38a] hfiles 2023-09-21 08:02:48,804 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testEmptyExportFileSystemState/091b765069f12e171daf3f3abb915946/cf/70e7bccd46614742b8031d97abf32221 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,804 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testEmptyExportFileSystemState/3f1c30ffcd7c1ae1776a49bd35141148/cf/f974b643a7a64934aea78a4131bbd38a for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,812 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695283367711.091b765069f12e171daf3f3abb915946. completed. 2023-09-21 08:02:48,812 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695283367711.091b765069f12e171daf3f3abb915946. 2023-09-21 08:02:48,812 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 08:02:48,812 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 08:02:48,812 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:48,812 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-21 08:02:48,812 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43299,1695283279840' in zk 2023-09-21 08:02:48,812 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695283367711.3f1c30ffcd7c1ae1776a49bd35141148. completed. 2023-09-21 08:02:48,812 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695283367711.3f1c30ffcd7c1ae1776a49bd35141148. 2023-09-21 08:02:48,812 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 08:02:48,812 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 08:02:48,813 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:48,813 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-21 08:02:48,813 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40677,1695283279880' in zk 2023-09-21 08:02:48,814 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:48,814 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-21 08:02:48,814 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:02:48,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:48,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:02:48,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:02:48,814 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-21 08:02:48,816 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:48,816 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-21 08:02:48,816 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:02:48,816 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-21 08:02:48,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:02:48,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:02:48,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:48,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:48,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:48,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:02:48,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:48,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:48,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:48,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43299,1695283279840': 2023-09-21 08:02:48,820 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43299,1695283279840' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-21 08:02:48,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:48,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:02:48,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:02:48,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:02:48,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:02:48,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:48,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:48,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:48,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:02:48,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:48,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:48,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:48,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40677,1695283279880': 2023-09-21 08:02:48,823 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40677,1695283279880' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-21 08:02:48,823 INFO [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-21 08:02:48,823 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-21 08:02:48,823 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-21 08:02:48,823 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,823 INFO [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-21 08:02:48,826 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,826 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:02:48,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:02:48,826 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:02:48,826 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,826 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,826 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:02:48,826 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:02:48,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,826 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:48,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:02:48,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:02:48,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:02:48,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:02:48,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:02:48,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:02:48,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:02:48,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,827 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:48,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:02:48,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,827 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:48,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:48,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:48,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:48,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:02:48,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,829 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:48,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:48,829 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:48,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:48,829 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:48,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:48,831 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 08:02:48,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-21 08:02:48,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-21 08:02:48,832 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:48,832 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:48,832 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-21 08:02:48,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:48,832 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:02:48,832 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:48,832 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:48,832 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:02:48,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:48,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:48,832 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,832 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,832 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:48,832 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-21 08:02:48,832 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:02:48,832 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:02:48,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:48,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:02:48,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:02:48,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:48,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:48,832 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,832 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:48,834 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-21 08:02:48,834 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,834 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:48,834 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:02:48,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:02:48,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:02:48,834 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:48,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:02:48,834 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:48,834 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,834 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,835 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309212e5cdd3b4a454bb5b70c170ed5da6d08, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230921c94bfc18e7f14efcbbde101dca9a2a80] mob files 2023-09-21 08:02:48,835 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309212e5cdd3b4a454bb5b70c170ed5da6d08 2023-09-21 08:02:48,835 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230921c94bfc18e7f14efcbbde101dca9a2a80 2023-09-21 08:02:48,865 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,869 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,886 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-21 08:02:48,886 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,886 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:48,886 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695283368729Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695283368865 (+136 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1695283368865Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1695283368865Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1695283368872 (+7 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1695283368879 (+7 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695283368886 (+7 ms) 2023-09-21 08:02:48,891 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-21 08:02:48,893 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 161 msec 2023-09-21 08:02:49,032 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 08:02:49,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-21 08:02:49,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-21 08:02:49,034 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283369034 2023-09-21 08:02:49,034 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42401, tgtDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283369034, rawTgtDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283369034, srcFsUri=hdfs://localhost:42401, srcDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52 2023-09-21 08:02:49,056 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42401, inputRoot=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52 2023-09-21 08:02:49,056 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-165828938_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283369034, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283369034/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:49,056 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42401, inputRoot=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52, snapshotDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-21 08:02:49,062 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283369034/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:49,082 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:49,083 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:49,083 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:49,084 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:49,958 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/hadoop-411594579848007224.jar 2023-09-21 08:02:49,959 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:49,959 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:50,026 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/hadoop-4840884366659049477.jar 2023-09-21 08:02:50,026 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:50,026 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:50,027 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:50,027 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:50,027 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:50,028 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-21 08:02:50,028 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-21 08:02:50,028 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-21 08:02:50,029 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-21 08:02:50,029 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-21 08:02:50,029 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-21 08:02:50,030 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-21 08:02:50,030 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-21 08:02:50,030 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-21 08:02:50,031 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-21 08:02:50,031 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-21 08:02:50,032 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 08:02:50,032 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 08:02:50,033 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-21 08:02:50,033 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 08:02:50,033 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 08:02:50,034 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-21 08:02:50,034 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-21 08:02:50,391 WARN [Listener at jenkins-hbase4.apache.org/40119] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-21 08:02:50,394 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-21 08:02:51,495 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-21 08:02:51,496 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-21 08:02:51,498 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695283286442_0005_000001 (auth:SIMPLE) 2023-09-21 08:02:51,929 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695283286442_0006_000001 (auth:SIMPLE) 2023-09-21 08:02:52,587 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-21 08:02:55,720 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695283286442_0006_000001 (auth:SIMPLE) 2023-09-21 08:02:58,733 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-21 08:02:58,734 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-21 08:02:58,739 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:58,740 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-21 08:02:58,740 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-21 08:02:58,740 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-501182444_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:58,741 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(367): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-21 08:02:58,741 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(367): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-21 08:02:58,741 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-501182444_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283369034/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283369034/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:58,741 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(367): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283369034/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-21 08:02:58,741 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(367): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283369034/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-21 08:02:58,746 INFO [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-21 08:02:58,746 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-09-21 08:02:58,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-21 08:02:58,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-21 08:02:58,750 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695283378750"}]},"ts":"1695283378750"} 2023-09-21 08:02:58,752 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-21 08:02:58,753 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-21 08:02:58,754 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3f1c30ffcd7c1ae1776a49bd35141148, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=091b765069f12e171daf3f3abb915946, UNASSIGN}] 2023-09-21 08:02:58,755 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3f1c30ffcd7c1ae1776a49bd35141148, UNASSIGN 2023-09-21 08:02:58,756 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=091b765069f12e171daf3f3abb915946, UNASSIGN 2023-09-21 08:02:58,757 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=3f1c30ffcd7c1ae1776a49bd35141148, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:58,757 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=091b765069f12e171daf3f3abb915946, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:58,757 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695283367711.3f1c30ffcd7c1ae1776a49bd35141148.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695283378757"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695283378757"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695283378757"}]},"ts":"1695283378757"} 2023-09-21 08:02:58,757 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695283367711.091b765069f12e171daf3f3abb915946.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695283378757"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695283378757"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695283378757"}]},"ts":"1695283378757"} 2023-09-21 08:02:58,758 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 3f1c30ffcd7c1ae1776a49bd35141148, server=jenkins-hbase4.apache.org,40677,1695283279880}] 2023-09-21 08:02:58,759 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 091b765069f12e171daf3f3abb915946, server=jenkins-hbase4.apache.org,43299,1695283279840}] 2023-09-21 08:02:58,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-21 08:02:58,909 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3f1c30ffcd7c1ae1776a49bd35141148 2023-09-21 08:02:58,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3f1c30ffcd7c1ae1776a49bd35141148, disabling compactions & flushes 2023-09-21 08:02:58,910 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695283367711.3f1c30ffcd7c1ae1776a49bd35141148. 2023-09-21 08:02:58,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695283367711.3f1c30ffcd7c1ae1776a49bd35141148. 2023-09-21 08:02:58,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695283367711.3f1c30ffcd7c1ae1776a49bd35141148. after waiting 0 ms 2023-09-21 08:02:58,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695283367711.3f1c30ffcd7c1ae1776a49bd35141148. 2023-09-21 08:02:58,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 091b765069f12e171daf3f3abb915946 2023-09-21 08:02:58,914 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 091b765069f12e171daf3f3abb915946, disabling compactions & flushes 2023-09-21 08:02:58,914 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695283367711.091b765069f12e171daf3f3abb915946. 2023-09-21 08:02:58,914 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695283367711.091b765069f12e171daf3f3abb915946. 2023-09-21 08:02:58,914 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695283367711.091b765069f12e171daf3f3abb915946. after waiting 0 ms 2023-09-21 08:02:58,914 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695283367711.091b765069f12e171daf3f3abb915946. 2023-09-21 08:02:58,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testEmptyExportFileSystemState/3f1c30ffcd7c1ae1776a49bd35141148/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-21 08:02:58,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testEmptyExportFileSystemState/091b765069f12e171daf3f3abb915946/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-21 08:02:58,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 08:02:58,921 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695283367711.3f1c30ffcd7c1ae1776a49bd35141148. 2023-09-21 08:02:58,921 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3f1c30ffcd7c1ae1776a49bd35141148: 2023-09-21 08:02:58,921 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 08:02:58,922 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695283367711.091b765069f12e171daf3f3abb915946. 2023-09-21 08:02:58,922 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 091b765069f12e171daf3f3abb915946: 2023-09-21 08:02:58,923 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3f1c30ffcd7c1ae1776a49bd35141148 2023-09-21 08:02:58,924 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=3f1c30ffcd7c1ae1776a49bd35141148, regionState=CLOSED 2023-09-21 08:02:58,924 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695283367711.3f1c30ffcd7c1ae1776a49bd35141148.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695283378923"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695283378923"}]},"ts":"1695283378923"} 2023-09-21 08:02:58,924 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 091b765069f12e171daf3f3abb915946 2023-09-21 08:02:58,924 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=091b765069f12e171daf3f3abb915946, regionState=CLOSED 2023-09-21 08:02:58,924 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695283367711.091b765069f12e171daf3f3abb915946.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695283378924"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695283378924"}]},"ts":"1695283378924"} 2023-09-21 08:02:58,927 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-09-21 08:02:58,927 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 3f1c30ffcd7c1ae1776a49bd35141148, server=jenkins-hbase4.apache.org,40677,1695283279880 in 168 msec 2023-09-21 08:02:58,928 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-09-21 08:02:58,928 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 091b765069f12e171daf3f3abb915946, server=jenkins-hbase4.apache.org,43299,1695283279840 in 167 msec 2023-09-21 08:02:58,928 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3f1c30ffcd7c1ae1776a49bd35141148, UNASSIGN in 173 msec 2023-09-21 08:02:58,929 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=99 2023-09-21 08:02:58,929 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=091b765069f12e171daf3f3abb915946, UNASSIGN in 174 msec 2023-09-21 08:02:58,930 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695283378930"}]},"ts":"1695283378930"} 2023-09-21 08:02:58,931 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-21 08:02:58,934 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-21 08:02:58,935 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 188 msec 2023-09-21 08:02:59,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-21 08:02:59,053 INFO [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-21 08:02:59,054 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-09-21 08:02:59,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-21 08:02:59,057 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-21 08:02:59,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-21 08:02:59,058 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-21 08:02:59,059 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43299] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-21 08:02:59,062 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-21 08:02:59,062 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-21 08:02:59,062 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-21 08:02:59,062 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-21 08:02:59,062 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testEmptyExportFileSystemState/3f1c30ffcd7c1ae1776a49bd35141148 2023-09-21 08:02:59,062 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testEmptyExportFileSystemState/091b765069f12e171daf3f3abb915946 2023-09-21 08:02:59,062 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-21 08:02:59,062 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-21 08:02:59,062 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-21 08:02:59,064 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-21 08:02:59,064 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-21 08:02:59,064 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:02:59,064 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-21 08:02:59,064 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:02:59,064 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:02:59,064 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testEmptyExportFileSystemState/091b765069f12e171daf3f3abb915946/cf, FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testEmptyExportFileSystemState/091b765069f12e171daf3f3abb915946/recovered.edits] 2023-09-21 08:02:59,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-21 08:02:59,065 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testEmptyExportFileSystemState/3f1c30ffcd7c1ae1776a49bd35141148/cf, FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testEmptyExportFileSystemState/3f1c30ffcd7c1ae1776a49bd35141148/recovered.edits] 2023-09-21 08:02:59,069 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testEmptyExportFileSystemState/091b765069f12e171daf3f3abb915946/cf/70e7bccd46614742b8031d97abf32221 to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/archive/data/default/testtb-testEmptyExportFileSystemState/091b765069f12e171daf3f3abb915946/cf/70e7bccd46614742b8031d97abf32221 2023-09-21 08:02:59,069 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testEmptyExportFileSystemState/3f1c30ffcd7c1ae1776a49bd35141148/cf/f974b643a7a64934aea78a4131bbd38a to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/archive/data/default/testtb-testEmptyExportFileSystemState/3f1c30ffcd7c1ae1776a49bd35141148/cf/f974b643a7a64934aea78a4131bbd38a 2023-09-21 08:02:59,072 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testEmptyExportFileSystemState/091b765069f12e171daf3f3abb915946/recovered.edits/9.seqid to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/archive/data/default/testtb-testEmptyExportFileSystemState/091b765069f12e171daf3f3abb915946/recovered.edits/9.seqid 2023-09-21 08:02:59,072 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testEmptyExportFileSystemState/3f1c30ffcd7c1ae1776a49bd35141148/recovered.edits/9.seqid to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/archive/data/default/testtb-testEmptyExportFileSystemState/3f1c30ffcd7c1ae1776a49bd35141148/recovered.edits/9.seqid 2023-09-21 08:02:59,073 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testEmptyExportFileSystemState/091b765069f12e171daf3f3abb915946 2023-09-21 08:02:59,073 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-21 08:02:59,073 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testEmptyExportFileSystemState/3f1c30ffcd7c1ae1776a49bd35141148 2023-09-21 08:02:59,073 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-21 08:02:59,073 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-21 08:02:59,073 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:02:59,073 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-21 08:02:59,074 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-21 08:02:59,078 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309212e5cdd3b4a454bb5b70c170ed5da6d08 to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309212e5cdd3b4a454bb5b70c170ed5da6d08 2023-09-21 08:02:59,080 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230921c94bfc18e7f14efcbbde101dca9a2a80 to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230921c94bfc18e7f14efcbbde101dca9a2a80 2023-09-21 08:02:59,080 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-21 08:02:59,083 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-21 08:02:59,085 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-21 08:02:59,087 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-21 08:02:59,089 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-21 08:02:59,089 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-21 08:02:59,089 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1695283367711.3f1c30ffcd7c1ae1776a49bd35141148.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695283379089"}]},"ts":"9223372036854775807"} 2023-09-21 08:02:59,089 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1695283367711.091b765069f12e171daf3f3abb915946.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695283379089"}]},"ts":"9223372036854775807"} 2023-09-21 08:02:59,091 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-21 08:02:59,091 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3f1c30ffcd7c1ae1776a49bd35141148, NAME => 'testtb-testEmptyExportFileSystemState,,1695283367711.3f1c30ffcd7c1ae1776a49bd35141148.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 091b765069f12e171daf3f3abb915946, NAME => 'testtb-testEmptyExportFileSystemState,1,1695283367711.091b765069f12e171daf3f3abb915946.', STARTKEY => '1', ENDKEY => ''}] 2023-09-21 08:02:59,091 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-21 08:02:59,091 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695283379091"}]},"ts":"9223372036854775807"} 2023-09-21 08:02:59,093 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-21 08:02:59,096 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-21 08:02:59,097 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 42 msec 2023-09-21 08:02:59,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-21 08:02:59,166 INFO [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-21 08:02:59,173 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-21 08:02:59,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:59,177 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-21 08:02:59,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-21 08:02:59,207 INFO [Listener at jenkins-hbase4.apache.org/40119] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=765 (was 757) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-501182444_17 at /127.0.0.1:54496 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4609 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x47a0dadd-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_495328602_1 at /127.0.0.1:54472 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x47a0dadd-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1104155582) connection to jenkins-hbase4.apache.org/172.31.14.131:39425 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-501182444_17 at /127.0.0.1:53758 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x47a0dadd-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1104155582) connection to jenkins-hbase4.apache.org/172.31.14.131:41647 from appattempt_1695283286442_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1104155582) connection to jenkins-hbase4.apache.org/172.31.14.131:45437 from appattempt_1695283286442_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_495328602_1 at /127.0.0.1:55546 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x47a0dadd-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-501182444_17 at /127.0.0.1:55386 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=934 (was 911) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=155 (was 145) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=2239 (was 2270) 2023-09-21 08:02:59,207 WARN [Listener at jenkins-hbase4.apache.org/40119] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-21 08:02:59,230 INFO [Listener at jenkins-hbase4.apache.org/40119] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765, OpenFileDescriptor=934, MaxFileDescriptor=60000, SystemLoadAverage=155, ProcessCount=168, AvailableMemoryMB=2238 2023-09-21 08:02:59,230 WARN [Listener at jenkins-hbase4.apache.org/40119] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-21 08:02:59,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-21 08:02:59,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 08:02:59,236 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-21 08:02:59,236 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-21 08:02:59,236 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-21 08:02:59,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-21 08:02:59,239 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1cc2df8ea6f6182814cbc74e9ebf3f2e 2023-09-21 08:02:59,239 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9ce9c784106565a8df5d7685bb3b18b 2023-09-21 08:02:59,240 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1cc2df8ea6f6182814cbc74e9ebf3f2e empty. 2023-09-21 08:02:59,240 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9ce9c784106565a8df5d7685bb3b18b empty. 2023-09-21 08:02:59,240 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1cc2df8ea6f6182814cbc74e9ebf3f2e 2023-09-21 08:02:59,240 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9ce9c784106565a8df5d7685bb3b18b 2023-09-21 08:02:59,240 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-21 08:02:59,250 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-21 08:02:59,251 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1cc2df8ea6f6182814cbc74e9ebf3f2e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695283379231.1cc2df8ea6f6182814cbc74e9ebf3f2e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp 2023-09-21 08:02:59,252 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => e9ce9c784106565a8df5d7685bb3b18b, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695283379231.e9ce9c784106565a8df5d7685bb3b18b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp 2023-09-21 08:02:59,267 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695283379231.1cc2df8ea6f6182814cbc74e9ebf3f2e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 08:02:59,267 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695283379231.e9ce9c784106565a8df5d7685bb3b18b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 08:02:59,267 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 1cc2df8ea6f6182814cbc74e9ebf3f2e, disabling compactions & flushes 2023-09-21 08:02:59,267 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing e9ce9c784106565a8df5d7685bb3b18b, disabling compactions & flushes 2023-09-21 08:02:59,267 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695283379231.1cc2df8ea6f6182814cbc74e9ebf3f2e. 2023-09-21 08:02:59,268 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695283379231.1cc2df8ea6f6182814cbc74e9ebf3f2e. 2023-09-21 08:02:59,268 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695283379231.e9ce9c784106565a8df5d7685bb3b18b. 2023-09-21 08:02:59,268 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695283379231.1cc2df8ea6f6182814cbc74e9ebf3f2e. after waiting 0 ms 2023-09-21 08:02:59,268 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695283379231.e9ce9c784106565a8df5d7685bb3b18b. 2023-09-21 08:02:59,268 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695283379231.1cc2df8ea6f6182814cbc74e9ebf3f2e. 2023-09-21 08:02:59,268 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695283379231.e9ce9c784106565a8df5d7685bb3b18b. after waiting 0 ms 2023-09-21 08:02:59,268 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695283379231.1cc2df8ea6f6182814cbc74e9ebf3f2e. 2023-09-21 08:02:59,268 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695283379231.e9ce9c784106565a8df5d7685bb3b18b. 2023-09-21 08:02:59,268 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 1cc2df8ea6f6182814cbc74e9ebf3f2e: 2023-09-21 08:02:59,268 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695283379231.e9ce9c784106565a8df5d7685bb3b18b. 2023-09-21 08:02:59,268 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for e9ce9c784106565a8df5d7685bb3b18b: 2023-09-21 08:02:59,271 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-21 08:02:59,272 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695283379231.1cc2df8ea6f6182814cbc74e9ebf3f2e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695283379271"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695283379271"}]},"ts":"1695283379271"} 2023-09-21 08:02:59,272 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695283379231.e9ce9c784106565a8df5d7685bb3b18b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695283379271"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695283379271"}]},"ts":"1695283379271"} 2023-09-21 08:02:59,274 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-21 08:02:59,275 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-21 08:02:59,275 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695283379275"}]},"ts":"1695283379275"} 2023-09-21 08:02:59,277 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-21 08:02:59,280 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-21 08:02:59,281 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-21 08:02:59,281 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-21 08:02:59,281 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-21 08:02:59,281 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-21 08:02:59,282 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=1cc2df8ea6f6182814cbc74e9ebf3f2e, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e9ce9c784106565a8df5d7685bb3b18b, ASSIGN}] 2023-09-21 08:02:59,284 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=1cc2df8ea6f6182814cbc74e9ebf3f2e, ASSIGN 2023-09-21 08:02:59,285 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e9ce9c784106565a8df5d7685bb3b18b, ASSIGN 2023-09-21 08:02:59,285 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=1cc2df8ea6f6182814cbc74e9ebf3f2e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40677,1695283279880; forceNewPlan=false, retain=false 2023-09-21 08:02:59,285 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e9ce9c784106565a8df5d7685bb3b18b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43299,1695283279840; forceNewPlan=false, retain=false 2023-09-21 08:02:59,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-21 08:02:59,435 INFO [jenkins-hbase4:34581] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-21 08:02:59,438 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=e9ce9c784106565a8df5d7685bb3b18b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:59,438 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=1cc2df8ea6f6182814cbc74e9ebf3f2e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:59,439 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695283379231.e9ce9c784106565a8df5d7685bb3b18b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695283379438"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695283379438"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695283379438"}]},"ts":"1695283379438"} 2023-09-21 08:02:59,439 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695283379231.1cc2df8ea6f6182814cbc74e9ebf3f2e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695283379438"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695283379438"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695283379438"}]},"ts":"1695283379438"} 2023-09-21 08:02:59,440 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure e9ce9c784106565a8df5d7685bb3b18b, server=jenkins-hbase4.apache.org,43299,1695283279840}] 2023-09-21 08:02:59,441 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 1cc2df8ea6f6182814cbc74e9ebf3f2e, server=jenkins-hbase4.apache.org,40677,1695283279880}] 2023-09-21 08:02:59,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-21 08:02:59,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1695283379231.1cc2df8ea6f6182814cbc74e9ebf3f2e. 2023-09-21 08:02:59,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1695283379231.e9ce9c784106565a8df5d7685bb3b18b. 2023-09-21 08:02:59,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1cc2df8ea6f6182814cbc74e9ebf3f2e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695283379231.1cc2df8ea6f6182814cbc74e9ebf3f2e.', STARTKEY => '', ENDKEY => '1'} 2023-09-21 08:02:59,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e9ce9c784106565a8df5d7685bb3b18b, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695283379231.e9ce9c784106565a8df5d7685bb3b18b.', STARTKEY => '1', ENDKEY => ''} 2023-09-21 08:02:59,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1695283379231.1cc2df8ea6f6182814cbc74e9ebf3f2e. service=AccessControlService 2023-09-21 08:02:59,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1695283379231.e9ce9c784106565a8df5d7685bb3b18b. service=AccessControlService 2023-09-21 08:02:59,596 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 08:02:59,596 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-21 08:02:59,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 1cc2df8ea6f6182814cbc74e9ebf3f2e 2023-09-21 08:02:59,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp e9ce9c784106565a8df5d7685bb3b18b 2023-09-21 08:02:59,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695283379231.1cc2df8ea6f6182814cbc74e9ebf3f2e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 08:02:59,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695283379231.e9ce9c784106565a8df5d7685bb3b18b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-21 08:02:59,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1cc2df8ea6f6182814cbc74e9ebf3f2e 2023-09-21 08:02:59,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e9ce9c784106565a8df5d7685bb3b18b 2023-09-21 08:02:59,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1cc2df8ea6f6182814cbc74e9ebf3f2e 2023-09-21 08:02:59,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e9ce9c784106565a8df5d7685bb3b18b 2023-09-21 08:02:59,597 INFO [StoreOpener-1cc2df8ea6f6182814cbc74e9ebf3f2e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1cc2df8ea6f6182814cbc74e9ebf3f2e 2023-09-21 08:02:59,597 INFO [StoreOpener-e9ce9c784106565a8df5d7685bb3b18b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e9ce9c784106565a8df5d7685bb3b18b 2023-09-21 08:02:59,598 DEBUG [StoreOpener-1cc2df8ea6f6182814cbc74e9ebf3f2e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithSkipTmp/1cc2df8ea6f6182814cbc74e9ebf3f2e/cf 2023-09-21 08:02:59,598 DEBUG [StoreOpener-1cc2df8ea6f6182814cbc74e9ebf3f2e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithSkipTmp/1cc2df8ea6f6182814cbc74e9ebf3f2e/cf 2023-09-21 08:02:59,598 DEBUG [StoreOpener-e9ce9c784106565a8df5d7685bb3b18b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9ce9c784106565a8df5d7685bb3b18b/cf 2023-09-21 08:02:59,598 DEBUG [StoreOpener-e9ce9c784106565a8df5d7685bb3b18b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9ce9c784106565a8df5d7685bb3b18b/cf 2023-09-21 08:02:59,599 INFO [StoreOpener-1cc2df8ea6f6182814cbc74e9ebf3f2e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1cc2df8ea6f6182814cbc74e9ebf3f2e columnFamilyName cf 2023-09-21 08:02:59,599 INFO [StoreOpener-e9ce9c784106565a8df5d7685bb3b18b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e9ce9c784106565a8df5d7685bb3b18b columnFamilyName cf 2023-09-21 08:02:59,600 INFO [StoreOpener-e9ce9c784106565a8df5d7685bb3b18b-1] regionserver.HStore(310): Store=e9ce9c784106565a8df5d7685bb3b18b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 08:02:59,600 INFO [StoreOpener-1cc2df8ea6f6182814cbc74e9ebf3f2e-1] regionserver.HStore(310): Store=1cc2df8ea6f6182814cbc74e9ebf3f2e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-21 08:02:59,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithSkipTmp/1cc2df8ea6f6182814cbc74e9ebf3f2e 2023-09-21 08:02:59,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9ce9c784106565a8df5d7685bb3b18b 2023-09-21 08:02:59,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithSkipTmp/1cc2df8ea6f6182814cbc74e9ebf3f2e 2023-09-21 08:02:59,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9ce9c784106565a8df5d7685bb3b18b 2023-09-21 08:02:59,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1cc2df8ea6f6182814cbc74e9ebf3f2e 2023-09-21 08:02:59,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e9ce9c784106565a8df5d7685bb3b18b 2023-09-21 08:02:59,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithSkipTmp/1cc2df8ea6f6182814cbc74e9ebf3f2e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-21 08:02:59,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9ce9c784106565a8df5d7685bb3b18b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-21 08:02:59,605 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1cc2df8ea6f6182814cbc74e9ebf3f2e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71550719, jitterRate=0.06618879735469818}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-21 08:02:59,605 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e9ce9c784106565a8df5d7685bb3b18b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67542901, jitterRate=0.006467655301094055}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-21 08:02:59,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1cc2df8ea6f6182814cbc74e9ebf3f2e: 2023-09-21 08:02:59,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e9ce9c784106565a8df5d7685bb3b18b: 2023-09-21 08:02:59,606 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1695283379231.e9ce9c784106565a8df5d7685bb3b18b., pid=108, masterSystemTime=1695283379592 2023-09-21 08:02:59,606 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1695283379231.1cc2df8ea6f6182814cbc74e9ebf3f2e., pid=109, masterSystemTime=1695283379592 2023-09-21 08:02:59,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1695283379231.e9ce9c784106565a8df5d7685bb3b18b. 2023-09-21 08:02:59,607 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1695283379231.e9ce9c784106565a8df5d7685bb3b18b. 2023-09-21 08:02:59,608 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=e9ce9c784106565a8df5d7685bb3b18b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:59,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1695283379231.1cc2df8ea6f6182814cbc74e9ebf3f2e. 2023-09-21 08:02:59,608 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1695283379231.1cc2df8ea6f6182814cbc74e9ebf3f2e. 2023-09-21 08:02:59,608 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695283379231.e9ce9c784106565a8df5d7685bb3b18b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695283379608"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695283379608"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695283379608"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695283379608"}]},"ts":"1695283379608"} 2023-09-21 08:02:59,608 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=1cc2df8ea6f6182814cbc74e9ebf3f2e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:59,608 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695283379231.1cc2df8ea6f6182814cbc74e9ebf3f2e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695283379608"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695283379608"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695283379608"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695283379608"}]},"ts":"1695283379608"} 2023-09-21 08:02:59,611 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=107 2023-09-21 08:02:59,611 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure e9ce9c784106565a8df5d7685bb3b18b, server=jenkins-hbase4.apache.org,43299,1695283279840 in 169 msec 2023-09-21 08:02:59,612 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=106 2023-09-21 08:02:59,612 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 1cc2df8ea6f6182814cbc74e9ebf3f2e, server=jenkins-hbase4.apache.org,40677,1695283279880 in 169 msec 2023-09-21 08:02:59,612 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e9ce9c784106565a8df5d7685bb3b18b, ASSIGN in 330 msec 2023-09-21 08:02:59,613 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=106, resume processing ppid=105 2023-09-21 08:02:59,613 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=1cc2df8ea6f6182814cbc74e9ebf3f2e, ASSIGN in 331 msec 2023-09-21 08:02:59,614 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-21 08:02:59,614 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695283379614"}]},"ts":"1695283379614"} 2023-09-21 08:02:59,615 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-21 08:02:59,617 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-21 08:02:59,617 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-21 08:02:59,619 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43299] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-21 08:02:59,621 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:02:59,621 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:02:59,621 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:02:59,621 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:02:59,623 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-21 08:02:59,623 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-21 08:02:59,623 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-21 08:02:59,623 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-21 08:02:59,624 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 391 msec 2023-09-21 08:02:59,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-21 08:02:59,841 INFO [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-21 08:02:59,843 DEBUG [Listener at jenkins-hbase4.apache.org/40119] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 08:02:59,843 DEBUG [Listener at jenkins-hbase4.apache.org/40119] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695283379231.1cc2df8ea6f6182814cbc74e9ebf3f2e. 2023-09-21 08:02:59,845 INFO [Listener at jenkins-hbase4.apache.org/40119] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-21 08:02:59,855 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-21 08:02:59,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695283379856 (current time:1695283379856). 2023-09-21 08:02:59,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-21 08:02:59,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(139): Connect 0x4675b361 to 127.0.0.1:58708 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 08:02:59,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35955fbf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 08:02:59,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:02:59,867 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51462, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:02:59,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4675b361 to 127.0.0.1:58708 2023-09-21 08:02:59,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 08:02:59,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(139): Connect 0x206d5de1 to 127.0.0.1:58708 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 08:02:59,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4be80c36, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 08:02:59,877 DEBUG [hconnection-0x549fca53-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:02:59,880 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51472, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:02:59,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:02:59,887 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42912, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:02:59,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x206d5de1 to 127.0.0.1:58708 2023-09-21 08:02:59,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 08:02:59,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-21 08:02:59,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-21 08:02:59,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-21 08:02:59,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-21 08:02:59,892 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-21 08:02:59,893 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695283979893 2023-09-21 08:02:59,893 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 08:02:59,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-21 08:02:59,894 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-21 08:02:59,894 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-21 08:02:59,895 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-21 08:02:59,895 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-21 08:02:59,896 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-09-21 08:02:59,897 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-21 08:02:59,897 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695283979897 2023-09-21 08:02:59,907 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:02:59,907 INFO [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-21 08:02:59,907 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:02:59,909 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-21 08:02:59,909 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-21 08:02:59,909 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:02:59,909 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:02:59,911 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:59,911 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:59,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:59,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:59,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:59,911 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:59,911 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:02:59,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:59,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:02:59,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:02:59,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:02:59,911 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:59,911 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:59,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:02:59,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:02:59,911 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:02:59,912 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:59,912 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-21 08:02:59,912 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:02:59,912 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:02:59,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-21 08:02:59,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:02:59,912 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-21 08:02:59,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-21 08:02:59,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:02:59,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-21 08:02:59,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:02:59,912 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:02:59,912 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-21 08:02:59,912 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-21 08:02:59,912 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-21 08:02:59,912 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:02:59,912 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:02:59,914 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:02:59,914 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-21 08:02:59,914 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-21 08:02:59,914 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-21 08:02:59,914 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:02:59,914 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:02:59,914 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-21 08:02:59,915 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-21 08:02:59,916 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-21 08:02:59,916 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-21 08:02:59,916 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36469,1695283279785' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-21 08:02:59,915 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43299,1695283279840' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-21 08:02:59,916 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-21 08:02:59,916 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40677,1695283279880' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-21 08:02:59,924 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:02:59,925 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:02:59,925 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:02:59,925 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 08:02:59,925 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:59,925 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:02:59,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:59,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:02:59,925 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:02:59,925 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:59,925 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 08:02:59,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:02:59,925 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:02:59,925 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 08:02:59,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:02:59,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:02:59,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:02:59,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:59,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:59,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:59,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:02:59,927 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43299,1695283279840' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-21 08:02:59,927 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@436d78a1[Count = 1] remaining members to acquire global barrier 2023-09-21 08:02:59,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:59,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:02:59,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:02:59,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:02:59,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:02:59,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:02:59,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:59,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:59,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:59,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:02:59,929 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40677,1695283279880' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-21 08:02:59,929 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@436d78a1[Count = 0] remaining members to acquire global barrier 2023-09-21 08:02:59,929 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-21 08:02:59,929 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:02:59,931 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:02:59,931 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:02:59,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:02:59,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:02:59,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:02:59,931 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:02:59,931 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-21 08:02:59,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:02:59,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:02:59,931 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:59,931 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-21 08:02:59,931 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 08:02:59,931 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 08:02:59,931 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695283379231.e9ce9c784106565a8df5d7685bb3b18b. 2023-09-21 08:02:59,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:02:59,931 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695283379231.e9ce9c784106565a8df5d7685bb3b18b. started... 2023-09-21 08:02:59,931 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-21 08:02:59,931 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:59,931 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-21 08:02:59,931 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-21 08:02:59,931 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,36469,1695283279785' in zk 2023-09-21 08:02:59,933 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e9ce9c784106565a8df5d7685bb3b18b: 2023-09-21 08:02:59,933 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695283379231.e9ce9c784106565a8df5d7685bb3b18b.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:02:59,933 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 08:02:59,933 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-21 08:02:59,934 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-21 08:02:59,934 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:02:59,934 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-21 08:02:59,936 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 08:02:59,936 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695283379231.1cc2df8ea6f6182814cbc74e9ebf3f2e. 2023-09-21 08:02:59,936 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 08:02:59,937 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695283379231.1cc2df8ea6f6182814cbc74e9ebf3f2e. started... 2023-09-21 08:02:59,937 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1cc2df8ea6f6182814cbc74e9ebf3f2e: 2023-09-21 08:02:59,937 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695283379231.1cc2df8ea6f6182814cbc74e9ebf3f2e.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:02:59,937 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 08:02:59,937 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-21 08:02:59,956 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695283379231.1cc2df8ea6f6182814cbc74e9ebf3f2e. completed. 2023-09-21 08:02:59,956 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695283379231.1cc2df8ea6f6182814cbc74e9ebf3f2e. 2023-09-21 08:02:59,956 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 08:02:59,956 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 08:02:59,956 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:59,956 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-21 08:02:59,956 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40677,1695283279880' in zk 2023-09-21 08:02:59,959 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-21 08:02:59,959 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:59,959 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:02:59,959 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-21 08:02:59,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:59,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:02:59,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:02:59,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:02:59,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:02:59,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:02:59,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:02:59,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:59,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:59,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:02:59,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:02:59,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:02:59,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:02:59,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40677,1695283279880': 2023-09-21 08:02:59,964 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40677,1695283279880' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-21 08:02:59,995 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 08:02:59,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-21 08:02:59,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-21 08:02:59,997 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-21 08:03:00,197 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 08:03:00,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-21 08:03:00,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-21 08:03:00,198 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-21 08:03:00,355 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695283379231.e9ce9c784106565a8df5d7685bb3b18b. completed. 2023-09-21 08:03:00,355 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695283379231.e9ce9c784106565a8df5d7685bb3b18b. 2023-09-21 08:03:00,355 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 08:03:00,355 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 08:03:00,355 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:03:00,355 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-21 08:03:00,355 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43299,1695283279840' in zk 2023-09-21 08:03:00,357 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:03:00,357 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-21 08:03:00,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:03:00,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:03:00,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:03:00,357 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:03:00,357 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-21 08:03:00,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:03:00,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:03:00,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:03:00,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:03:00,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:03:00,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:03:00,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:03:00,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:03:00,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:03:00,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43299,1695283279840': 2023-09-21 08:03:00,362 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43299,1695283279840' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-21 08:03:00,362 INFO [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-21 08:03:00,362 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-21 08:03:00,362 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-21 08:03:00,362 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,362 INFO [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-21 08:03:00,363 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,363 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,363 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:03:00,363 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:03:00,363 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,363 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:03:00,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:03:00,364 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:03:00,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,364 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:03:00,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:03:00,364 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:03:00,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:03:00,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:03:00,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:03:00,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:03:00,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:03:00,364 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:03:00,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:03:00,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:03:00,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:03:00,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:03:00,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:03:00,366 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:03:00,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:03:00,366 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:03:00,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,367 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:03:00,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:03:00,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:03:00,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:03:00,369 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:03:00,369 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,369 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:03:00,369 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:03:00,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:03:00,369 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:03:00,369 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:03:00,369 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:03:00,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:03:00,370 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:03:00,370 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,370 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:03:00,370 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:03:00,370 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,369 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:03:00,370 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-21 08:03:00,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:03:00,370 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,370 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:03:00,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:03:00,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:03:00,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:03:00,370 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:03:00,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:03:00,372 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,372 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:03:00,372 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-21 08:03:00,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:03:00,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:03:00,372 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:03:00,372 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:03:00,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:03:00,372 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,381 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,381 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,399 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,399 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-21 08:03:00,399 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,400 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,400 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695283379893Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695283380381 (+488 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695283380381Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695283380381Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695283380384 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695283380393 (+9 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695283380399 (+6 ms) 2023-09-21 08:03:00,403 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-21 08:03:00,404 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 509 msec 2023-09-21 08:03:00,498 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 08:03:00,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-21 08:03:00,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-21 08:03:00,501 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40677] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1695283379231.1cc2df8ea6f6182814cbc74e9ebf3f2e. with WAL disabled. Data may be lost in the event of a crash. 2023-09-21 08:03:00,502 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43299] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1695283379231.e9ce9c784106565a8df5d7685bb3b18b. with WAL disabled. Data may be lost in the event of a crash. 2023-09-21 08:03:00,505 DEBUG [Listener at jenkins-hbase4.apache.org/40119] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,505 DEBUG [Listener at jenkins-hbase4.apache.org/40119] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695283379231.1cc2df8ea6f6182814cbc74e9ebf3f2e. 2023-09-21 08:03:00,506 INFO [Listener at jenkins-hbase4.apache.org/40119] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-21 08:03:00,514 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-21 08:03:00,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695283380514 (current time:1695283380514). 2023-09-21 08:03:00,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-21 08:03:00,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(139): Connect 0x2bd351a6 to 127.0.0.1:58708 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 08:03:00,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b4dbdd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 08:03:00,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:03:00,525 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51478, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:03:00,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2bd351a6 to 127.0.0.1:58708 2023-09-21 08:03:00,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 08:03:00,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(139): Connect 0x0d27b225 to 127.0.0.1:58708 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-21 08:03:00,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c488c46, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-21 08:03:00,534 DEBUG [hconnection-0x1b85d221-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:03:00,541 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51492, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:03:00,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-21 08:03:00,548 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42918, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-21 08:03:00,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0d27b225 to 127.0.0.1:58708 2023-09-21 08:03:00,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 08:03:00,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-21 08:03:00,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-21 08:03:00,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-21 08:03:00,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-21 08:03:00,553 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-21 08:03:00,554 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695283980554 2023-09-21 08:03:00,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-21 08:03:00,554 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,555 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-21 08:03:00,555 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-21 08:03:00,556 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-21 08:03:00,556 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-21 08:03:00,557 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-09-21 08:03:00,557 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-21 08:03:00,558 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695283980558 2023-09-21 08:03:00,570 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,570 INFO [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-21 08:03:00,570 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:03:00,572 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-21 08:03:00,572 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-21 08:03:00,572 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,572 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,575 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:03:00,575 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:03:00,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:03:00,575 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:03:00,575 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:03:00,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:03:00,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:03:00,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:03:00,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:03:00,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:03:00,575 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:03:00,575 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:03:00,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,575 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:03:00,575 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-21 08:03:00,576 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,576 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,576 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-21 08:03:00,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,576 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-21 08:03:00,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-21 08:03:00,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,576 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-21 08:03:00,576 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-21 08:03:00,576 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-21 08:03:00,576 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,576 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:03:00,576 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-21 08:03:00,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,578 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-21 08:03:00,578 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-21 08:03:00,576 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:03:00,578 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-21 08:03:00,579 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-21 08:03:00,579 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-21 08:03:00,579 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40677,1695283279880' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-21 08:03:00,578 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36469,1695283279785' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-21 08:03:00,579 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,579 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-21 08:03:00,579 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-21 08:03:00,580 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-21 08:03:00,580 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-21 08:03:00,580 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43299,1695283279840' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-21 08:03:00,581 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,581 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,581 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:03:00,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:03:00,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:03:00,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:03:00,582 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:03:00,582 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,582 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:03:00,582 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,582 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 08:03:00,582 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 08:03:00,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:03:00,583 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,583 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-21 08:03:00,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:03:00,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:03:00,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:03:00,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:03:00,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40677,1695283279880' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-21 08:03:00,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@60780120[Count = 1] remaining members to acquire global barrier 2023-09-21 08:03:00,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:03:00,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:03:00,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:03:00,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:03:00,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:03:00,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:03:00,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:03:00,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:03:00,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:03:00,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43299,1695283279840' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-21 08:03:00,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@60780120[Count = 0] remaining members to acquire global barrier 2023-09-21 08:03:00,586 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-21 08:03:00,586 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,592 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,592 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,592 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,592 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-21 08:03:00,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,592 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-21 08:03:00,592 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-21 08:03:00,592 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-21 08:03:00,592 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,36469,1695283279785' in zk 2023-09-21 08:03:00,592 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 08:03:00,592 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 08:03:00,592 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:03:00,592 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-21 08:03:00,592 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695283379231.1cc2df8ea6f6182814cbc74e9ebf3f2e. 2023-09-21 08:03:00,592 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695283379231.e9ce9c784106565a8df5d7685bb3b18b. 2023-09-21 08:03:00,592 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695283379231.1cc2df8ea6f6182814cbc74e9ebf3f2e. started... 2023-09-21 08:03:00,592 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-21 08:03:00,592 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695283379231.e9ce9c784106565a8df5d7685bb3b18b. started... 2023-09-21 08:03:00,593 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:03:00,593 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-21 08:03:00,593 INFO [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1cc2df8ea6f6182814cbc74e9ebf3f2e 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-21 08:03:00,593 INFO [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e9ce9c784106565a8df5d7685bb3b18b 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-21 08:03:00,594 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-21 08:03:00,594 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:03:00,594 DEBUG [member: 'jenkins-hbase4.apache.org,36469,1695283279785' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-21 08:03:00,614 INFO [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023092156780e2eef3241fd9ae21ec8443349b4 to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023092156780e2eef3241fd9ae21ec8443349b4 2023-09-21 08:03:00,614 INFO [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230921c174e72058094f4983a7af106c11564e to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230921c174e72058094f4983a7af106c11564e 2023-09-21 08:03:00,624 INFO [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9ce9c784106565a8df5d7685bb3b18b/.tmp/cf/cd13f52f9205487485b32153a869ec62 2023-09-21 08:03:00,626 INFO [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithSkipTmp/1cc2df8ea6f6182814cbc74e9ebf3f2e/.tmp/cf/4323ff20de9f492fae2b566df71ffa1b 2023-09-21 08:03:00,631 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9ce9c784106565a8df5d7685bb3b18b/.tmp/cf/cd13f52f9205487485b32153a869ec62 as hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9ce9c784106565a8df5d7685bb3b18b/cf/cd13f52f9205487485b32153a869ec62 2023-09-21 08:03:00,632 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithSkipTmp/1cc2df8ea6f6182814cbc74e9ebf3f2e/.tmp/cf/4323ff20de9f492fae2b566df71ffa1b as hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithSkipTmp/1cc2df8ea6f6182814cbc74e9ebf3f2e/cf/4323ff20de9f492fae2b566df71ffa1b 2023-09-21 08:03:00,635 INFO [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9ce9c784106565a8df5d7685bb3b18b/cf/cd13f52f9205487485b32153a869ec62, entries=48, sequenceid=6, filesize=13.5 K 2023-09-21 08:03:00,636 INFO [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for e9ce9c784106565a8df5d7685bb3b18b in 43ms, sequenceid=6, compaction requested=false 2023-09-21 08:03:00,636 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-21 08:03:00,637 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e9ce9c784106565a8df5d7685bb3b18b: 2023-09-21 08:03:00,637 INFO [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithSkipTmp/1cc2df8ea6f6182814cbc74e9ebf3f2e/cf/4323ff20de9f492fae2b566df71ffa1b, entries=2, sequenceid=6, filesize=5.2 K 2023-09-21 08:03:00,637 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695283379231.e9ce9c784106565a8df5d7685bb3b18b.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,637 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 08:03:00,637 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9ce9c784106565a8df5d7685bb3b18b/cf/cd13f52f9205487485b32153a869ec62] hfiles 2023-09-21 08:03:00,637 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9ce9c784106565a8df5d7685bb3b18b/cf/cd13f52f9205487485b32153a869ec62 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,638 INFO [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 1cc2df8ea6f6182814cbc74e9ebf3f2e in 45ms, sequenceid=6, compaction requested=false 2023-09-21 08:03:00,640 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1cc2df8ea6f6182814cbc74e9ebf3f2e: 2023-09-21 08:03:00,640 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695283379231.1cc2df8ea6f6182814cbc74e9ebf3f2e.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,640 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-21 08:03:00,640 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithSkipTmp/1cc2df8ea6f6182814cbc74e9ebf3f2e/cf/4323ff20de9f492fae2b566df71ffa1b] hfiles 2023-09-21 08:03:00,640 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithSkipTmp/1cc2df8ea6f6182814cbc74e9ebf3f2e/cf/4323ff20de9f492fae2b566df71ffa1b for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,646 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695283379231.e9ce9c784106565a8df5d7685bb3b18b. completed. 2023-09-21 08:03:00,646 DEBUG [rs(jenkins-hbase4.apache.org,43299,1695283279840)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695283379231.e9ce9c784106565a8df5d7685bb3b18b. 2023-09-21 08:03:00,647 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695283379231.1cc2df8ea6f6182814cbc74e9ebf3f2e. completed. 2023-09-21 08:03:00,647 DEBUG [rs(jenkins-hbase4.apache.org,40677,1695283279880)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695283379231.1cc2df8ea6f6182814cbc74e9ebf3f2e. 2023-09-21 08:03:00,647 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 08:03:00,647 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-21 08:03:00,647 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 08:03:00,647 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-21 08:03:00,647 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:03:00,647 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:03:00,647 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-21 08:03:00,647 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-21 08:03:00,647 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43299,1695283279840' in zk 2023-09-21 08:03:00,647 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40677,1695283279880' in zk 2023-09-21 08:03:00,649 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:03:00,649 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-21 08:03:00,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:03:00,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:03:00,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:03:00,649 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:03:00,649 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-21 08:03:00,649 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:03:00,649 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:03:00,649 DEBUG [member: 'jenkins-hbase4.apache.org,40677,1695283279880' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-21 08:03:00,649 DEBUG [member: 'jenkins-hbase4.apache.org,43299,1695283279840' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-21 08:03:00,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:03:00,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:03:00,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:03:00,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:03:00,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:03:00,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:03:00,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:03:00,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:03:00,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:03:00,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43299,1695283279840': 2023-09-21 08:03:00,654 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43299,1695283279840' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-21 08:03:00,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:03:00,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:03:00,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:03:00,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:03:00,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:03:00,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:03:00,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:03:00,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:03:00,656 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 08:03:00,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:03:00,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:03:00,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-21 08:03:00,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-21 08:03:00,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:03:00,657 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-21 08:03:00,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:03:00,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40677,1695283279880': 2023-09-21 08:03:00,658 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40677,1695283279880' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-21 08:03:00,658 INFO [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-21 08:03:00,658 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-21 08:03:00,658 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-21 08:03:00,658 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,658 INFO [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-21 08:03:00,659 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,659 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,659 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-21 08:03:00,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-21 08:03:00,659 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:03:00,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,659 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:03:00,659 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,660 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:03:00,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-21 08:03:00,660 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:03:00,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:03:00,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:03:00,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:03:00,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:03:00,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:03:00,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:03:00,660 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:03:00,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-21 08:03:00,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,661 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:03:00,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:03:00,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:03:00,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:03:00,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-21 08:03:00,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,662 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:03:00,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:03:00,663 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:03:00,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:03:00,663 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:03:00,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:03:00,667 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:03:00,667 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,667 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:03:00,667 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:03:00,667 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:03:00,667 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-21 08:03:00,667 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:03:00,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:03:00,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:03:00,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-21 08:03:00,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:03:00,667 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:03:00,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:03:00,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-21 08:03:00,667 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-21 08:03:00,667 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,667 DEBUG [(jenkins-hbase4.apache.org,34581,1695283278509)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-21 08:03:00,668 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:03:00,669 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,667 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:03:00,669 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-21 08:03:00,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:03:00,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:03:00,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-21 08:03:00,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:03:00,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-21 08:03:00,669 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,670 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:03:00,670 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,670 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:03:00,670 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:03:00,670 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,670 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,670 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023092156780e2eef3241fd9ae21ec8443349b4, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230921c174e72058094f4983a7af106c11564e] mob files 2023-09-21 08:03:00,670 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023092156780e2eef3241fd9ae21ec8443349b4 2023-09-21 08:03:00,670 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230921c174e72058094f4983a7af106c11564e 2023-09-21 08:03:00,677 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,677 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,698 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,698 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-21 08:03:00,699 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,699 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,699 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695283380554Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695283380677 (+123 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695283380677Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1695283380677Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1695283380680 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695283380692 (+12 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695283380698 (+6 ms) 2023-09-21 08:03:00,702 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-21 08:03:00,703 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 147 msec 2023-09-21 08:03:00,857 DEBUG [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-21 08:03:00,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-21 08:03:00,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-21 08:03:00,858 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283380858 2023-09-21 08:03:00,859 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42401, tgtDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283380858, rawTgtDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283380858, srcFsUri=hdfs://localhost:42401, srcDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52 2023-09-21 08:03:00,881 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42401, inputRoot=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52 2023-09-21 08:03:00,881 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1357632666_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283380858, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283380858/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,881 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42401, inputRoot=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52, snapshotDir=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-21 08:03:00,890 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283380858/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:00,915 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-21 08:03:00,916 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-21 08:03:00,916 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-21 08:03:00,916 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-21 08:03:01,790 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/hadoop-4774161925726107186.jar 2023-09-21 08:03:01,791 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-21 08:03:01,791 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-21 08:03:01,857 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/hadoop-6387284289459633991.jar 2023-09-21 08:03:01,857 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-21 08:03:01,858 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-21 08:03:01,858 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-21 08:03:01,859 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-21 08:03:01,859 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-21 08:03:01,859 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-21 08:03:01,860 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-21 08:03:01,860 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-21 08:03:01,860 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-21 08:03:01,861 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-21 08:03:01,861 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-21 08:03:01,861 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-21 08:03:01,862 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-21 08:03:01,862 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-21 08:03:01,862 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-21 08:03:01,863 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-21 08:03:01,863 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 08:03:01,864 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 08:03:01,864 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-21 08:03:01,864 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 08:03:01,864 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-21 08:03:01,865 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-21 08:03:01,865 DEBUG [Listener at jenkins-hbase4.apache.org/40119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-21 08:03:02,224 WARN [Listener at jenkins-hbase4.apache.org/40119] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-21 08:03:02,226 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-21 08:03:02,228 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-21 08:03:03,039 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-21 08:03:03,040 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-21 08:03:03,043 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695283286442_0006_000001 (auth:SIMPLE) 2023-09-21 08:03:03,510 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695283286442_0007_000001 (auth:SIMPLE) 2023-09-21 08:03:04,520 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-21 08:03:07,340 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695283286442_0007_000001 (auth:SIMPLE) 2023-09-21 08:03:09,564 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695283286442_0007_000001 (auth:SIMPLE) 2023-09-21 08:03:12,093 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695283286442_0007_000001 (auth:SIMPLE) 2023-09-21 08:03:13,386 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-21 08:03:13,386 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-21 08:03:13,396 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:13,396 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-21 08:03:13,397 INFO [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-21 08:03:13,397 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-501182444_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:13,397 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(367): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-21 08:03:13,397 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(367): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-21 08:03:13,397 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-501182444_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283380858/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283380858/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:13,398 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(367): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283380858/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-21 08:03:13,398 DEBUG [Listener at jenkins-hbase4.apache.org/40119] snapshot.TestExportSnapshot(367): hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/export-test/export-1695283380858/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-21 08:03:13,404 INFO [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:13,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:13,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:13,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-21 08:03:13,408 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695283393408"}]},"ts":"1695283393408"} 2023-09-21 08:03:13,409 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-21 08:03:13,411 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-21 08:03:13,411 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=1cc2df8ea6f6182814cbc74e9ebf3f2e, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e9ce9c784106565a8df5d7685bb3b18b, UNASSIGN}] 2023-09-21 08:03:13,414 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=1cc2df8ea6f6182814cbc74e9ebf3f2e, UNASSIGN 2023-09-21 08:03:13,414 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e9ce9c784106565a8df5d7685bb3b18b, UNASSIGN 2023-09-21 08:03:13,414 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=1cc2df8ea6f6182814cbc74e9ebf3f2e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:03:13,414 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=e9ce9c784106565a8df5d7685bb3b18b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:03:13,414 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695283379231.1cc2df8ea6f6182814cbc74e9ebf3f2e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695283393414"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695283393414"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695283393414"}]},"ts":"1695283393414"} 2023-09-21 08:03:13,414 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695283379231.e9ce9c784106565a8df5d7685bb3b18b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695283393414"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695283393414"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695283393414"}]},"ts":"1695283393414"} 2023-09-21 08:03:13,416 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 1cc2df8ea6f6182814cbc74e9ebf3f2e, server=jenkins-hbase4.apache.org,40677,1695283279880}] 2023-09-21 08:03:13,416 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure e9ce9c784106565a8df5d7685bb3b18b, server=jenkins-hbase4.apache.org,43299,1695283279840}] 2023-09-21 08:03:13,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-21 08:03:13,567 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e9ce9c784106565a8df5d7685bb3b18b 2023-09-21 08:03:13,567 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1cc2df8ea6f6182814cbc74e9ebf3f2e 2023-09-21 08:03:13,568 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e9ce9c784106565a8df5d7685bb3b18b, disabling compactions & flushes 2023-09-21 08:03:13,568 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1cc2df8ea6f6182814cbc74e9ebf3f2e, disabling compactions & flushes 2023-09-21 08:03:13,568 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695283379231.e9ce9c784106565a8df5d7685bb3b18b. 2023-09-21 08:03:13,568 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695283379231.e9ce9c784106565a8df5d7685bb3b18b. 2023-09-21 08:03:13,568 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695283379231.1cc2df8ea6f6182814cbc74e9ebf3f2e. 2023-09-21 08:03:13,568 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695283379231.e9ce9c784106565a8df5d7685bb3b18b. after waiting 0 ms 2023-09-21 08:03:13,568 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695283379231.e9ce9c784106565a8df5d7685bb3b18b. 2023-09-21 08:03:13,568 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695283379231.1cc2df8ea6f6182814cbc74e9ebf3f2e. 2023-09-21 08:03:13,568 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695283379231.1cc2df8ea6f6182814cbc74e9ebf3f2e. after waiting 0 ms 2023-09-21 08:03:13,568 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695283379231.1cc2df8ea6f6182814cbc74e9ebf3f2e. 2023-09-21 08:03:13,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithSkipTmp/1cc2df8ea6f6182814cbc74e9ebf3f2e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-21 08:03:13,580 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9ce9c784106565a8df5d7685bb3b18b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-21 08:03:13,580 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 08:03:13,581 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695283379231.1cc2df8ea6f6182814cbc74e9ebf3f2e. 2023-09-21 08:03:13,581 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1cc2df8ea6f6182814cbc74e9ebf3f2e: 2023-09-21 08:03:13,581 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 08:03:13,582 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695283379231.e9ce9c784106565a8df5d7685bb3b18b. 2023-09-21 08:03:13,582 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e9ce9c784106565a8df5d7685bb3b18b: 2023-09-21 08:03:13,584 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1cc2df8ea6f6182814cbc74e9ebf3f2e 2023-09-21 08:03:13,585 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=1cc2df8ea6f6182814cbc74e9ebf3f2e, regionState=CLOSED 2023-09-21 08:03:13,585 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695283379231.1cc2df8ea6f6182814cbc74e9ebf3f2e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695283393585"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695283393585"}]},"ts":"1695283393585"} 2023-09-21 08:03:13,585 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e9ce9c784106565a8df5d7685bb3b18b 2023-09-21 08:03:13,585 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=e9ce9c784106565a8df5d7685bb3b18b, regionState=CLOSED 2023-09-21 08:03:13,585 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695283379231.e9ce9c784106565a8df5d7685bb3b18b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695283393585"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695283393585"}]},"ts":"1695283393585"} 2023-09-21 08:03:13,589 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-09-21 08:03:13,589 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 1cc2df8ea6f6182814cbc74e9ebf3f2e, server=jenkins-hbase4.apache.org,40677,1695283279880 in 172 msec 2023-09-21 08:03:13,590 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-09-21 08:03:13,590 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure e9ce9c784106565a8df5d7685bb3b18b, server=jenkins-hbase4.apache.org,43299,1695283279840 in 171 msec 2023-09-21 08:03:13,590 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=1cc2df8ea6f6182814cbc74e9ebf3f2e, UNASSIGN in 178 msec 2023-09-21 08:03:13,591 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=116, resume processing ppid=114 2023-09-21 08:03:13,591 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e9ce9c784106565a8df5d7685bb3b18b, UNASSIGN in 179 msec 2023-09-21 08:03:13,592 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695283393592"}]},"ts":"1695283393592"} 2023-09-21 08:03:13,593 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-21 08:03:13,595 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-21 08:03:13,597 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 191 msec 2023-09-21 08:03:13,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-21 08:03:13,710 INFO [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-21 08:03:13,711 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:13,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:13,714 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:13,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:13,715 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:13,716 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43299] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:13,719 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1cc2df8ea6f6182814cbc74e9ebf3f2e 2023-09-21 08:03:13,719 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9ce9c784106565a8df5d7685bb3b18b 2023-09-21 08:03:13,721 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:13,721 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:13,721 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:13,721 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:13,721 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1cc2df8ea6f6182814cbc74e9ebf3f2e/cf, FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1cc2df8ea6f6182814cbc74e9ebf3f2e/recovered.edits] 2023-09-21 08:03:13,721 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9ce9c784106565a8df5d7685bb3b18b/cf, FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9ce9c784106565a8df5d7685bb3b18b/recovered.edits] 2023-09-21 08:03:13,723 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-21 08:03:13,723 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-21 08:03:13,724 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:13,724 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:03:13,724 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:03:13,724 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:03:13,724 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:13,724 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-09-21 08:03:13,724 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-09-21 08:03:13,724 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-21 08:03:13,724 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-21 08:03:13,724 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-21 08:03:13,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-21 08:03:13,726 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9ce9c784106565a8df5d7685bb3b18b/cf/cd13f52f9205487485b32153a869ec62 to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9ce9c784106565a8df5d7685bb3b18b/cf/cd13f52f9205487485b32153a869ec62 2023-09-21 08:03:13,726 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1cc2df8ea6f6182814cbc74e9ebf3f2e/cf/4323ff20de9f492fae2b566df71ffa1b to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/1cc2df8ea6f6182814cbc74e9ebf3f2e/cf/4323ff20de9f492fae2b566df71ffa1b 2023-09-21 08:03:13,729 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9ce9c784106565a8df5d7685bb3b18b/recovered.edits/9.seqid to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9ce9c784106565a8df5d7685bb3b18b/recovered.edits/9.seqid 2023-09-21 08:03:13,729 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1cc2df8ea6f6182814cbc74e9ebf3f2e/recovered.edits/9.seqid to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/1cc2df8ea6f6182814cbc74e9ebf3f2e/recovered.edits/9.seqid 2023-09-21 08:03:13,729 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9ce9c784106565a8df5d7685bb3b18b 2023-09-21 08:03:13,729 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1cc2df8ea6f6182814cbc74e9ebf3f2e 2023-09-21 08:03:13,729 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-21 08:03:13,730 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-21 08:03:13,730 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-21 08:03:13,734 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023092156780e2eef3241fd9ae21ec8443349b4 to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023092156780e2eef3241fd9ae21ec8443349b4 2023-09-21 08:03:13,734 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230921c174e72058094f4983a7af106c11564e to hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230921c174e72058094f4983a7af106c11564e 2023-09-21 08:03:13,735 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-21 08:03:13,737 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:13,738 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-21 08:03:13,740 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-21 08:03:13,741 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:13,741 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-21 08:03:13,741 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695283379231.1cc2df8ea6f6182814cbc74e9ebf3f2e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695283393741"}]},"ts":"9223372036854775807"} 2023-09-21 08:03:13,741 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695283379231.e9ce9c784106565a8df5d7685bb3b18b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695283393741"}]},"ts":"9223372036854775807"} 2023-09-21 08:03:13,743 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-21 08:03:13,743 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 1cc2df8ea6f6182814cbc74e9ebf3f2e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695283379231.1cc2df8ea6f6182814cbc74e9ebf3f2e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e9ce9c784106565a8df5d7685bb3b18b, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695283379231.e9ce9c784106565a8df5d7685bb3b18b.', STARTKEY => '1', ENDKEY => ''}] 2023-09-21 08:03:13,743 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-21 08:03:13,743 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695283393743"}]},"ts":"9223372036854775807"} 2023-09-21 08:03:13,744 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-21 08:03:13,746 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:13,747 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 35 msec 2023-09-21 08:03:13,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-21 08:03:13,826 INFO [Listener at jenkins-hbase4.apache.org/40119] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-21 08:03:13,832 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-21 08:03:13,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:13,835 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-21 08:03:13,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34581] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-21 08:03:13,863 INFO [Listener at jenkins-hbase4.apache.org/40119] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765 (was 765), OpenFileDescriptor=913 (was 934), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=171 (was 155) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=2163 (was 2238) 2023-09-21 08:03:13,863 WARN [Listener at jenkins-hbase4.apache.org/40119] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-21 08:03:13,863 INFO [Listener at jenkins-hbase4.apache.org/40119] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-21 08:03:13,874 INFO [Listener at jenkins-hbase4.apache.org/40119] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-21 08:03:13,985 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1695283286442_0007_01_000001 is : 143 2023-09-21 08:03:19,148 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-21 08:03:27,999 INFO [Listener at jenkins-hbase4.apache.org/40119] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-21 08:03:42,116 ERROR [Thread[Thread-408,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-21 08:03:42,116 INFO [Listener at jenkins-hbase4.apache.org/40119] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-21 08:03:42,226 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-21 08:03:42,235 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-21 08:03:42,236 ERROR [Thread[Thread-418,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-21 08:03:42,245 INFO [Listener at jenkins-hbase4.apache.org/40119] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-21 08:03:42,349 ERROR [Thread[Thread-383,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-21 08:03:42,349 INFO [Listener at jenkins-hbase4.apache.org/40119] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-21 08:03:42,349 INFO [Listener at jenkins-hbase4.apache.org/40119] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-21 08:03:42,349 INFO [Listener at jenkins-hbase4.apache.org/40119] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-21 08:03:42,349 DEBUG [Listener at jenkins-hbase4.apache.org/40119] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x51038fe2 to 127.0.0.1:58708 2023-09-21 08:03:42,349 DEBUG [Listener at jenkins-hbase4.apache.org/40119] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 08:03:42,349 DEBUG [Listener at jenkins-hbase4.apache.org/40119] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-21 08:03:42,349 DEBUG [Listener at jenkins-hbase4.apache.org/40119] util.JVMClusterUtil(257): Found active master hash=1579382845, stopped=false 2023-09-21 08:03:42,350 DEBUG [Listener at jenkins-hbase4.apache.org/40119] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 08:03:42,350 DEBUG [Listener at jenkins-hbase4.apache.org/40119] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-21 08:03:42,350 INFO [Listener at jenkins-hbase4.apache.org/40119] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,34581,1695283278509 2023-09-21 08:03:42,351 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-21 08:03:42,351 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-21 08:03:42,351 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-21 08:03:42,351 INFO [Listener at jenkins-hbase4.apache.org/40119] procedure2.ProcedureExecutor(628): Stopping 2023-09-21 08:03:42,351 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-21 08:03:42,352 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-21 08:03:42,352 DEBUG [Listener at jenkins-hbase4.apache.org/40119] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b01da1c to 127.0.0.1:58708 2023-09-21 08:03:42,352 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-21 08:03:42,352 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-21 08:03:42,352 DEBUG [Listener at jenkins-hbase4.apache.org/40119] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 08:03:42,352 INFO [Listener at jenkins-hbase4.apache.org/40119] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,36469,1695283279785' ***** 2023-09-21 08:03:42,352 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-21 08:03:42,352 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-21 08:03:42,352 DEBUG [Listener at jenkins-hbase4.apache.org/40119] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 08:03:42,353 INFO [Listener at jenkins-hbase4.apache.org/40119] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-21 08:03:42,353 INFO [Listener at jenkins-hbase4.apache.org/40119] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43299,1695283279840' ***** 2023-09-21 08:03:42,353 INFO [RS:0;jenkins-hbase4:36469] regionserver.HeapMemoryManager(220): Stopping 2023-09-21 08:03:42,353 DEBUG [Listener at jenkins-hbase4.apache.org/40119] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 08:03:42,353 INFO [Listener at jenkins-hbase4.apache.org/40119] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-21 08:03:42,353 INFO [Listener at jenkins-hbase4.apache.org/40119] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40677,1695283279880' ***** 2023-09-21 08:03:42,353 INFO [RS:0;jenkins-hbase4:36469] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-21 08:03:42,353 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-21 08:03:42,353 INFO [RS:0;jenkins-hbase4:36469] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-21 08:03:42,353 DEBUG [Listener at jenkins-hbase4.apache.org/40119] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 08:03:42,353 INFO [Listener at jenkins-hbase4.apache.org/40119] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-21 08:03:42,353 INFO [RS:1;jenkins-hbase4:43299] regionserver.HeapMemoryManager(220): Stopping 2023-09-21 08:03:42,353 INFO [RS:0;jenkins-hbase4:36469] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:03:42,354 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-21 08:03:42,354 DEBUG [RS:0;jenkins-hbase4:36469] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4959f279 to 127.0.0.1:58708 2023-09-21 08:03:42,354 INFO [RS:1;jenkins-hbase4:43299] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-21 08:03:42,354 INFO [RS:1;jenkins-hbase4:43299] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-21 08:03:42,354 INFO [RS:2;jenkins-hbase4:40677] regionserver.HeapMemoryManager(220): Stopping 2023-09-21 08:03:42,354 DEBUG [RS:0;jenkins-hbase4:36469] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 08:03:42,354 INFO [RS:1;jenkins-hbase4:43299] regionserver.HRegionServer(3305): Received CLOSE for 4bd099c1707db82441334f05c99fc4cc 2023-09-21 08:03:42,354 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-21 08:03:42,357 INFO [RS:0;jenkins-hbase4:36469] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-21 08:03:42,354 INFO [RS:2;jenkins-hbase4:40677] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-21 08:03:42,357 INFO [RS:0;jenkins-hbase4:36469] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-21 08:03:42,357 INFO [RS:1;jenkins-hbase4:43299] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:03:42,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4bd099c1707db82441334f05c99fc4cc, disabling compactions & flushes 2023-09-21 08:03:42,357 DEBUG [RS:1;jenkins-hbase4:43299] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68ef6e10 to 127.0.0.1:58708 2023-09-21 08:03:42,357 INFO [RS:0;jenkins-hbase4:36469] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-21 08:03:42,357 INFO [RS:2;jenkins-hbase4:40677] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-21 08:03:42,358 INFO [RS:0;jenkins-hbase4:36469] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-21 08:03:42,358 DEBUG [RS:1;jenkins-hbase4:43299] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 08:03:42,357 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695283282837.4bd099c1707db82441334f05c99fc4cc. 2023-09-21 08:03:42,358 INFO [RS:1;jenkins-hbase4:43299] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-21 08:03:42,358 INFO [RS:2;jenkins-hbase4:40677] regionserver.HRegionServer(3305): Received CLOSE for d502557a9f79976923de1cd15733cc21 2023-09-21 08:03:42,358 INFO [RS:0;jenkins-hbase4:36469] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-21 08:03:42,358 INFO [RS:2;jenkins-hbase4:40677] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:03:42,358 DEBUG [RS:0;jenkins-hbase4:36469] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-09-21 08:03:42,358 DEBUG [RS:2;jenkins-hbase4:40677] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x13afb71b to 127.0.0.1:58708 2023-09-21 08:03:42,358 DEBUG [RS:1;jenkins-hbase4:43299] regionserver.HRegionServer(1478): Online Regions={4bd099c1707db82441334f05c99fc4cc=hbase:acl,,1695283282837.4bd099c1707db82441334f05c99fc4cc.} 2023-09-21 08:03:42,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695283282837.4bd099c1707db82441334f05c99fc4cc. 2023-09-21 08:03:42,359 DEBUG [RS:2;jenkins-hbase4:40677] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 08:03:42,359 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-21 08:03:42,360 INFO [RS:2;jenkins-hbase4:40677] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-21 08:03:42,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d502557a9f79976923de1cd15733cc21, disabling compactions & flushes 2023-09-21 08:03:42,360 DEBUG [RS:2;jenkins-hbase4:40677] regionserver.HRegionServer(1478): Online Regions={d502557a9f79976923de1cd15733cc21=hbase:namespace,,1695283282097.d502557a9f79976923de1cd15733cc21.} 2023-09-21 08:03:42,360 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-21 08:03:42,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695283282837.4bd099c1707db82441334f05c99fc4cc. after waiting 0 ms 2023-09-21 08:03:42,360 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-21 08:03:42,360 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695283282097.d502557a9f79976923de1cd15733cc21. 2023-09-21 08:03:42,360 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-21 08:03:42,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695283282837.4bd099c1707db82441334f05c99fc4cc. 2023-09-21 08:03:42,360 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-21 08:03:42,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695283282097.d502557a9f79976923de1cd15733cc21. 2023-09-21 08:03:42,360 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-09-21 08:03:42,361 DEBUG [RS:2;jenkins-hbase4:40677] regionserver.HRegionServer(1504): Waiting on d502557a9f79976923de1cd15733cc21 2023-09-21 08:03:42,360 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 4bd099c1707db82441334f05c99fc4cc 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-21 08:03:42,361 DEBUG [RS:1;jenkins-hbase4:43299] regionserver.HRegionServer(1504): Waiting on 4bd099c1707db82441334f05c99fc4cc 2023-09-21 08:03:42,361 DEBUG [RS:0;jenkins-hbase4:36469] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-09-21 08:03:42,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695283282097.d502557a9f79976923de1cd15733cc21. after waiting 0 ms 2023-09-21 08:03:42,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695283282097.d502557a9f79976923de1cd15733cc21. 2023-09-21 08:03:42,361 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing d502557a9f79976923de1cd15733cc21 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-21 08:03:42,377 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-09-21 08:03:42,377 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-09-21 08:03:42,382 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-09-21 08:03:42,382 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-09-21 08:03:42,384 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/acl/4bd099c1707db82441334f05c99fc4cc/.tmp/l/d91ccda2714a483aa511a9018b9f0bdf 2023-09-21 08:03:42,384 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/namespace/d502557a9f79976923de1cd15733cc21/.tmp/info/7000310d8bcc4628a61c76de381116f3 2023-09-21 08:03:42,388 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/meta/1588230740/.tmp/info/61de5fc187004ebe9001515b5d0944f1 2023-09-21 08:03:42,390 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d91ccda2714a483aa511a9018b9f0bdf 2023-09-21 08:03:42,390 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-09-21 08:03:42,390 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-09-21 08:03:42,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/namespace/d502557a9f79976923de1cd15733cc21/.tmp/info/7000310d8bcc4628a61c76de381116f3 as hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/namespace/d502557a9f79976923de1cd15733cc21/info/7000310d8bcc4628a61c76de381116f3 2023-09-21 08:03:42,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/acl/4bd099c1707db82441334f05c99fc4cc/.tmp/l/d91ccda2714a483aa511a9018b9f0bdf as hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/acl/4bd099c1707db82441334f05c99fc4cc/l/d91ccda2714a483aa511a9018b9f0bdf 2023-09-21 08:03:42,394 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 61de5fc187004ebe9001515b5d0944f1 2023-09-21 08:03:42,395 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/namespace/d502557a9f79976923de1cd15733cc21/info/7000310d8bcc4628a61c76de381116f3, entries=2, sequenceid=6, filesize=4.8 K 2023-09-21 08:03:42,396 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d91ccda2714a483aa511a9018b9f0bdf 2023-09-21 08:03:42,396 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/acl/4bd099c1707db82441334f05c99fc4cc/l/d91ccda2714a483aa511a9018b9f0bdf, entries=7, sequenceid=18, filesize=5.2 K 2023-09-21 08:03:42,396 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for d502557a9f79976923de1cd15733cc21 in 35ms, sequenceid=6, compaction requested=false 2023-09-21 08:03:42,397 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 4bd099c1707db82441334f05c99fc4cc in 37ms, sequenceid=18, compaction requested=false 2023-09-21 08:03:42,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/namespace/d502557a9f79976923de1cd15733cc21/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-21 08:03:42,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 08:03:42,409 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695283282097.d502557a9f79976923de1cd15733cc21. 2023-09-21 08:03:42,409 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/acl/4bd099c1707db82441334f05c99fc4cc/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-21 08:03:42,409 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d502557a9f79976923de1cd15733cc21: 2023-09-21 08:03:42,409 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1695283282097.d502557a9f79976923de1cd15733cc21. 2023-09-21 08:03:42,409 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-21 08:03:42,409 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-21 08:03:42,409 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-21 08:03:42,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 08:03:42,410 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1695283282837.4bd099c1707db82441334f05c99fc4cc. 2023-09-21 08:03:42,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4bd099c1707db82441334f05c99fc4cc: 2023-09-21 08:03:42,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1695283282837.4bd099c1707db82441334f05c99fc4cc. 2023-09-21 08:03:42,413 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/meta/1588230740/.tmp/rep_barrier/e0a6579f16e14ddf9b319b00d6fe563c 2023-09-21 08:03:42,417 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e0a6579f16e14ddf9b319b00d6fe563c 2023-09-21 08:03:42,427 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/meta/1588230740/.tmp/table/ba3f9231f7cf40fc9febb9a6a87d8a10 2023-09-21 08:03:42,431 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ba3f9231f7cf40fc9febb9a6a87d8a10 2023-09-21 08:03:42,432 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/meta/1588230740/.tmp/info/61de5fc187004ebe9001515b5d0944f1 as hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/meta/1588230740/info/61de5fc187004ebe9001515b5d0944f1 2023-09-21 08:03:42,436 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 61de5fc187004ebe9001515b5d0944f1 2023-09-21 08:03:42,437 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/meta/1588230740/info/61de5fc187004ebe9001515b5d0944f1, entries=48, sequenceid=131, filesize=10.3 K 2023-09-21 08:03:42,438 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/meta/1588230740/.tmp/rep_barrier/e0a6579f16e14ddf9b319b00d6fe563c as hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/meta/1588230740/rep_barrier/e0a6579f16e14ddf9b319b00d6fe563c 2023-09-21 08:03:42,442 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e0a6579f16e14ddf9b319b00d6fe563c 2023-09-21 08:03:42,442 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/meta/1588230740/rep_barrier/e0a6579f16e14ddf9b319b00d6fe563c, entries=13, sequenceid=131, filesize=6.4 K 2023-09-21 08:03:42,443 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/meta/1588230740/.tmp/table/ba3f9231f7cf40fc9febb9a6a87d8a10 as hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/meta/1588230740/table/ba3f9231f7cf40fc9febb9a6a87d8a10 2023-09-21 08:03:42,448 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ba3f9231f7cf40fc9febb9a6a87d8a10 2023-09-21 08:03:42,448 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/meta/1588230740/table/ba3f9231f7cf40fc9febb9a6a87d8a10, entries=24, sequenceid=131, filesize=6.9 K 2023-09-21 08:03:42,449 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 89ms, sequenceid=131, compaction requested=false 2023-09-21 08:03:42,460 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-21 08:03:42,461 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-21 08:03:42,461 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-21 08:03:42,461 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-21 08:03:42,461 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-21 08:03:42,462 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-21 08:03:42,561 INFO [RS:2;jenkins-hbase4:40677] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40677,1695283279880; all regions closed. 2023-09-21 08:03:42,561 INFO [RS:1;jenkins-hbase4:43299] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43299,1695283279840; all regions closed. 2023-09-21 08:03:42,561 INFO [RS:0;jenkins-hbase4:36469] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,36469,1695283279785; all regions closed. 2023-09-21 08:03:42,573 DEBUG [RS:2;jenkins-hbase4:40677] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/oldWALs 2023-09-21 08:03:42,573 INFO [RS:2;jenkins-hbase4:40677] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40677%2C1695283279880:(num 1695283281542) 2023-09-21 08:03:42,573 DEBUG [RS:0;jenkins-hbase4:36469] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/oldWALs 2023-09-21 08:03:42,573 INFO [RS:0;jenkins-hbase4:36469] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36469%2C1695283279785.meta:.meta(num 1695283281799) 2023-09-21 08:03:42,573 DEBUG [RS:2;jenkins-hbase4:40677] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 08:03:42,573 INFO [RS:2;jenkins-hbase4:40677] regionserver.LeaseManager(133): Closed leases 2023-09-21 08:03:42,574 INFO [RS:2;jenkins-hbase4:40677] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-21 08:03:42,574 DEBUG [RS:1;jenkins-hbase4:43299] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/oldWALs 2023-09-21 08:03:42,574 INFO [RS:1;jenkins-hbase4:43299] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43299%2C1695283279840:(num 1695283281543) 2023-09-21 08:03:42,574 DEBUG [RS:1;jenkins-hbase4:43299] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 08:03:42,574 INFO [RS:1;jenkins-hbase4:43299] regionserver.LeaseManager(133): Closed leases 2023-09-21 08:03:42,574 INFO [RS:2;jenkins-hbase4:40677] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-21 08:03:42,574 INFO [RS:2;jenkins-hbase4:40677] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-21 08:03:42,574 INFO [RS:2;jenkins-hbase4:40677] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-21 08:03:42,574 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-21 08:03:42,574 INFO [RS:1;jenkins-hbase4:43299] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-21 08:03:42,575 INFO [RS:1;jenkins-hbase4:43299] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-21 08:03:42,575 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-21 08:03:42,575 INFO [RS:1;jenkins-hbase4:43299] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-21 08:03:42,575 INFO [RS:1;jenkins-hbase4:43299] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-21 08:03:42,576 INFO [RS:2;jenkins-hbase4:40677] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40677 2023-09-21 08:03:42,581 INFO [RS:1;jenkins-hbase4:43299] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43299 2023-09-21 08:03:42,583 DEBUG [RS:0;jenkins-hbase4:36469] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/oldWALs 2023-09-21 08:03:42,583 INFO [RS:0;jenkins-hbase4:36469] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36469%2C1695283279785:(num 1695283281543) 2023-09-21 08:03:42,583 DEBUG [RS:0;jenkins-hbase4:36469] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 08:03:42,583 INFO [RS:0;jenkins-hbase4:36469] regionserver.LeaseManager(133): Closed leases 2023-09-21 08:03:42,583 INFO [RS:0;jenkins-hbase4:36469] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-21 08:03:42,583 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-21 08:03:42,584 INFO [RS:0;jenkins-hbase4:36469] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36469 2023-09-21 08:03:42,586 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:03:42,586 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-21 08:03:42,586 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:03:42,586 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36469,1695283279785 2023-09-21 08:03:42,586 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-21 08:03:42,587 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-21 08:03:42,587 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-21 08:03:42,587 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:03:42,587 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43299,1695283279840] 2023-09-21 08:03:42,587 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:03:42,587 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43299,1695283279840 2023-09-21 08:03:42,587 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:03:42,588 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:03:42,588 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43299,1695283279840; numProcessing=1 2023-09-21 08:03:42,587 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40677,1695283279880 2023-09-21 08:03:42,590 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43299,1695283279840 already deleted, retry=false 2023-09-21 08:03:42,591 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43299,1695283279840 expired; onlineServers=2 2023-09-21 08:03:42,591 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36469,1695283279785] 2023-09-21 08:03:42,591 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36469,1695283279785; numProcessing=2 2023-09-21 08:03:42,592 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36469,1695283279785 already deleted, retry=false 2023-09-21 08:03:42,592 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36469,1695283279785 expired; onlineServers=1 2023-09-21 08:03:42,592 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40677,1695283279880] 2023-09-21 08:03:42,592 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40677,1695283279880; numProcessing=3 2023-09-21 08:03:42,593 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40677,1695283279880 already deleted, retry=false 2023-09-21 08:03:42,593 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40677,1695283279880 expired; onlineServers=0 2023-09-21 08:03:42,593 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34581,1695283278509' ***** 2023-09-21 08:03:42,593 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-21 08:03:42,593 DEBUG [M:0;jenkins-hbase4:34581] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f1e7206, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-21 08:03:42,593 INFO [M:0;jenkins-hbase4:34581] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34581,1695283278509 2023-09-21 08:03:42,593 INFO [M:0;jenkins-hbase4:34581] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34581,1695283278509; all regions closed. 2023-09-21 08:03:42,593 DEBUG [M:0;jenkins-hbase4:34581] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-21 08:03:42,593 DEBUG [M:0;jenkins-hbase4:34581] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-21 08:03:42,594 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-21 08:03:42,594 DEBUG [M:0;jenkins-hbase4:34581] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-21 08:03:42,594 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695283281203] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695283281203,5,FailOnTimeoutGroup] 2023-09-21 08:03:42,594 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695283281204] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695283281204,5,FailOnTimeoutGroup] 2023-09-21 08:03:42,594 INFO [M:0;jenkins-hbase4:34581] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-21 08:03:42,594 INFO [M:0;jenkins-hbase4:34581] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-21 08:03:42,594 INFO [M:0;jenkins-hbase4:34581] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-09-21 08:03:42,594 DEBUG [M:0;jenkins-hbase4:34581] master.HMaster(1512): Stopping service threads 2023-09-21 08:03:42,594 INFO [M:0;jenkins-hbase4:34581] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-21 08:03:42,594 ERROR [M:0;jenkins-hbase4:34581] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-13,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-09-21 08:03:42,595 INFO [M:0;jenkins-hbase4:34581] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-21 08:03:42,595 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-21 08:03:42,595 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-09-21 08:03:42,595 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-21 08:03:42,595 DEBUG [M:0;jenkins-hbase4:34581] zookeeper.ZKUtil(398): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-21 08:03:42,595 WARN [M:0;jenkins-hbase4:34581] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-21 08:03:42,595 INFO [M:0;jenkins-hbase4:34581] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-21 08:03:42,596 INFO [M:0;jenkins-hbase4:34581] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-21 08:03:42,596 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-21 08:03:42,596 DEBUG [M:0;jenkins-hbase4:34581] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-21 08:03:42,596 INFO [M:0;jenkins-hbase4:34581] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-21 08:03:42,596 DEBUG [M:0;jenkins-hbase4:34581] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-21 08:03:42,596 DEBUG [M:0;jenkins-hbase4:34581] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-21 08:03:42,596 DEBUG [M:0;jenkins-hbase4:34581] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-21 08:03:42,596 INFO [M:0;jenkins-hbase4:34581] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.64 KB heapSize=451.92 KB 2023-09-21 08:03:42,610 INFO [M:0;jenkins-hbase4:34581] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.64 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/66b9310b5c614ac28b341064002679a1 2023-09-21 08:03:42,613 INFO [M:0;jenkins-hbase4:34581] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 66b9310b5c614ac28b341064002679a1 2023-09-21 08:03:42,614 DEBUG [M:0;jenkins-hbase4:34581] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/66b9310b5c614ac28b341064002679a1 as hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/66b9310b5c614ac28b341064002679a1 2023-09-21 08:03:42,618 INFO [M:0;jenkins-hbase4:34581] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 66b9310b5c614ac28b341064002679a1 2023-09-21 08:03:42,618 INFO [M:0;jenkins-hbase4:34581] regionserver.HStore(1080): Added hdfs://localhost:42401/user/jenkins/test-data/24269f05-c985-3ab5-e92a-78e477aafd52/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/66b9310b5c614ac28b341064002679a1, entries=119, sequenceid=899, filesize=28.6 K 2023-09-21 08:03:42,619 INFO [M:0;jenkins-hbase4:34581] regionserver.HRegion(2948): Finished flush of dataSize ~375.64 KB/384657, heapSize ~451.91 KB/462752, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 23ms, sequenceid=899, compaction requested=false 2023-09-21 08:03:42,620 INFO [M:0;jenkins-hbase4:34581] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-21 08:03:42,620 DEBUG [M:0;jenkins-hbase4:34581] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-21 08:03:42,623 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-21 08:03:42,623 INFO [M:0;jenkins-hbase4:34581] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-21 08:03:42,624 INFO [M:0;jenkins-hbase4:34581] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34581 2023-09-21 08:03:42,625 DEBUG [M:0;jenkins-hbase4:34581] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,34581,1695283278509 already deleted, retry=false 2023-09-21 08:03:42,690 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-21 08:03:42,690 INFO [RS:0;jenkins-hbase4:36469] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,36469,1695283279785; zookeeper connection closed. 2023-09-21 08:03:42,690 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:36469-0x100cd8126510001, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-21 08:03:42,691 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1bfd4dff] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1bfd4dff 2023-09-21 08:03:42,790 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-21 08:03:42,790 INFO [M:0;jenkins-hbase4:34581] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34581,1695283278509; zookeeper connection closed. 2023-09-21 08:03:42,790 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): master:34581-0x100cd8126510000, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-21 08:03:42,891 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-21 08:03:42,891 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:40677-0x100cd8126510003, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-21 08:03:42,891 INFO [RS:2;jenkins-hbase4:40677] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40677,1695283279880; zookeeper connection closed. 2023-09-21 08:03:42,891 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@11e815d4] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@11e815d4 2023-09-21 08:03:42,991 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-21 08:03:42,991 INFO [RS:1;jenkins-hbase4:43299] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43299,1695283279840; zookeeper connection closed. 2023-09-21 08:03:42,991 DEBUG [Listener at localhost/44993-EventThread] zookeeper.ZKWatcher(600): regionserver:43299-0x100cd8126510002, quorum=127.0.0.1:58708, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-21 08:03:42,991 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@379234b8] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@379234b8 2023-09-21 08:03:42,991 INFO [Listener at jenkins-hbase4.apache.org/40119] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-21 08:03:42,992 WARN [Listener at jenkins-hbase4.apache.org/40119] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-21 08:03:42,995 INFO [Listener at jenkins-hbase4.apache.org/40119] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-21 08:03:43,099 WARN [BP-189035936-172.31.14.131-1695283274615 heartbeating to localhost/127.0.0.1:42401] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-21 08:03:43,099 WARN [BP-189035936-172.31.14.131-1695283274615 heartbeating to localhost/127.0.0.1:42401] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-189035936-172.31.14.131-1695283274615 (Datanode Uuid fe7cd8e3-3030-4a6a-ad4d-4e5ffaa054d7) service to localhost/127.0.0.1:42401 2023-09-21 08:03:43,101 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/cluster_a1516829-53a1-8a15-7b69-24c58f59b133/dfs/data/data5/current/BP-189035936-172.31.14.131-1695283274615] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-21 08:03:43,101 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/cluster_a1516829-53a1-8a15-7b69-24c58f59b133/dfs/data/data6/current/BP-189035936-172.31.14.131-1695283274615] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-21 08:03:43,102 WARN [Listener at jenkins-hbase4.apache.org/40119] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-21 08:03:43,104 INFO [Listener at jenkins-hbase4.apache.org/40119] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-21 08:03:43,208 WARN [BP-189035936-172.31.14.131-1695283274615 heartbeating to localhost/127.0.0.1:42401] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-21 08:03:43,208 WARN [BP-189035936-172.31.14.131-1695283274615 heartbeating to localhost/127.0.0.1:42401] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-189035936-172.31.14.131-1695283274615 (Datanode Uuid d3b0b7b9-a45e-4124-bf9a-1c81153548d8) service to localhost/127.0.0.1:42401 2023-09-21 08:03:43,209 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/cluster_a1516829-53a1-8a15-7b69-24c58f59b133/dfs/data/data3/current/BP-189035936-172.31.14.131-1695283274615] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-21 08:03:43,209 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/cluster_a1516829-53a1-8a15-7b69-24c58f59b133/dfs/data/data4/current/BP-189035936-172.31.14.131-1695283274615] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-21 08:03:43,210 WARN [Listener at jenkins-hbase4.apache.org/40119] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-21 08:03:43,215 INFO [Listener at jenkins-hbase4.apache.org/40119] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-21 08:03:43,318 WARN [BP-189035936-172.31.14.131-1695283274615 heartbeating to localhost/127.0.0.1:42401] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-21 08:03:43,318 WARN [BP-189035936-172.31.14.131-1695283274615 heartbeating to localhost/127.0.0.1:42401] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-189035936-172.31.14.131-1695283274615 (Datanode Uuid 52ce258f-a79c-418f-a60d-94176167cf08) service to localhost/127.0.0.1:42401 2023-09-21 08:03:43,319 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/cluster_a1516829-53a1-8a15-7b69-24c58f59b133/dfs/data/data1/current/BP-189035936-172.31.14.131-1695283274615] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-21 08:03:43,319 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/62a069b9-52cb-d3f8-d340-76f61e0ff52c/cluster_a1516829-53a1-8a15-7b69-24c58f59b133/dfs/data/data2/current/BP-189035936-172.31.14.131-1695283274615] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-21 08:03:43,344 INFO [Listener at jenkins-hbase4.apache.org/40119] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-21 08:03:43,470 INFO [Listener at jenkins-hbase4.apache.org/40119] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-21 08:03:43,555 INFO [Listener at jenkins-hbase4.apache.org/40119] hbase.HBaseTestingUtility(1293): Minicluster is down